With scraping data from the internet becoming more difficult and with new technologies being developed at a faster rate than ever before, I decided to build a new system (for personal use) called Prober, which designed to overcome the difficulties of scraping.
Prober scrapes websites (if robots.txt allow it to do so) without code or the use of xPaths. With websites constantly changing results in xPaths requiring changes, despite the fact that often, visually, nothing too drastic changes. Prober can predict visually where certain elements are placed on a page so that you don’t need need to update the xPaths. The system is trained, via visual annotation, on what an element looks like within a webpage; so doesn’t matter if a site’s layout slightly changes. Also It does not interact with the DOM at all which is what most scrapers rely on at the moment.
Prober is still in development but I can see the benefits and I’m loving it!
Locrafts is all about generating a buzz for local creativities using machine learning. It finds local gift makers and designers situated in the United Kingdom. Everything is pulled together, analysed and displayed in a single portal/website where the designers and their gifts are then displayed. The results can be filtered by the colours of the gift products and the location of the designers.
There are many factors behind Locrafts decision making process. Some of these include, analysing what you post on your website and what you share on your social media accounts (if api’s are permitted). Other factors are hidden for obvious reasons but the algorithm takes into account a lot of factors; it may decide against displaying some authors and their gifts on the platform. Therefore some of the gifts discovered may never reach the website in its attempt to reduce any spam gifts that could be posted and shared on the platform.
The system is built using cutting edge technologies: AWS is used for hosting the machine learning models, React is used for the front end interface and NodeJS is used for the backend api configuration.
More updates to come soon!
Target is a brand new digital marketing agency based in Penzance, Cornwall. They specialise in social media marketing, offering services in everything from PPC advertising to email marketing.
When I was approached by Josh to boost their website development skills, there were a couple of things that really caught my attention. Their punch line is – ‘we will guarantee results for you; we don’t hide behind the metrics’. Many digital marketing companies hide behind their metrics and don’t really show the value of their services, or their personal values. As someone who prides myself on providing a high quality service and upon delivering results, Target’s approach was music to my ears.
The requirement for this particular project was to develop a website that was smooth, delivered a visual impact and was interactive. This was always going to be an incredible project and I simply couldn’t wait to get started.
After a few meetings (over the internet) we had everything in place and development began. The vision was clear and the final website came together very smoothly. With a clear target (excuse the pun), the experience of developing the website really enjoyable. The site allowed me to learn new techniques; such as animating project screenshots with various transitions and revealing elements when they become visible on the screen.
If you are interested in outsourcing web development projects, click here, to get in touch and discuss your requirements.
What a superb project this was!