Abstract

Let’s get what we need for success. The key element for an edge in competition is sometimes only the data and the speed how to get it. We will build a simple crawler that will allow to get the insight of the usage of character in the most competitive cyber sports 🏈 Dota2 (prize pool for the top tier championship in 2021 was 41 mln$). The lessons that we will learn from it will benefit to every aspect of your applied common tasks. We will be able to extract, process and read the output of the data. This alone will boost the buisiness toolbelt and familiarize the audience with the quite effective tools like data pipelines, data feeds, output item structure. This solution for scraping also contains the high scalability and configurability