Monitoring

Crawler server has embedded web server. By default it listens on port 8001. To view basic stats, such as Crawler version, used memory, number of open files, and message broker status, run the following curl command (change host name if needed).

curl http://localhost:8001

{
  "application": "Crawler",
  "version": "1.0.0-SNAPSHOT",
  "buildTime": "2021-11-18T18:48:13Z",
  "mqType": "RabbitMQ",
  "mqConnection": "localhost:5672",
  "mqStatus": "UP",
  "usedMemory": "13 MB",
  "openFiles": "20"
}

NOTE: Number of open files is only available on Unix. The value is reported by JVM and includes some open system libraries and JARs.