How should we deal with the exponential increase in scrappers? The server admins will now need to daily search the logs and update robots.txt or the firewall to block all the new crawlers? The owners will need to pay more for increased infrastructure resources to deal with all this artificial visits. The traffic analytics will have a bad day trying to filter the human visits from the crawlers.

Migrating to PowerShell Microsoft Graph to monitor users and devices in Entra. Looking for device join type (Hybrid joined, Entra joined or Entra registered), Entra roles assigments, login logs and M365 provisioning errors.

For the non developers, the web industry is using .txt files at the root of a domain to provide guidance for different kind of bots wandering on the Internet and indexing/scrapping data. The bots can ignore the instructions, declare a different User-Agent or other kind of evasion methods. robots.txt - it instructs crawlers on which […]

NVIDIA has launched Chat With RTX , a demo application through which you can have your own chatbot, locally, using your data (documents and videos from Youtube).

Whan I am developing something I am more focused on the engineering behind and not on setting up basic things. I just use any available system and I will deal with the optimization at a later stage. This was the case also for rotrafic.xyz, it uses a double opt-in for registration so I used Sendingblue […]

The backdoor was planted in /wp-includes/ and the filename started with a dot in an attempt to hide the file .query.php