Set-up medium+ complex (here in Parrot Security OS – Debian Linux distribution).
Allows for crawl list of URL’s on flexible depth level with sophisticated keywords, generating crawl results in the Solr DB for subsequent analysis, analytics or export to graphic tools. Publish in dynamic Web site.
https://www.digitalocean.com/community/tutorials/how-to-install-java-with-apt-get-on-debian-8