Digging further into internet data mining: how website structure affects your website's visibility and ease-of-use for web scrapers (and why it should matter to you). This post will be a continuation of the previous excursion into web scraping I did, as I posted about here: https://techartworks.blogspot.com/2016/12/an-excursion-into-web-scraping-with.html In an attempt to take some first, be it tentative, steps into web scraping with Python this week (making use of the fantastic "requests" and "Beautifulsoup4" modules), I ran into a few walls, but also made a good bit of headway. In particular, I gained some insights into ways you could optimize your website's structure in order to improve its user friendlines both for users and web scrapers, thereby increasing the chances of your pages popping up when someone googles your name. Before going any further with this, there are a few notes I would like to make: Networks like LinkedIn provide ways to...
A space where I dump my Tech Art Brainwaves into a somewhat structured shape.