Web Scraping Trending from Tumblr with Web Data Extractor

In this article, we will tell you how to scrape trending from Tumblr using ScrapeStorm’s “Smart mode“.
Introduction to the scraping tool
ScrapeStorm (www.scrapestorm.com) is a new generation of Web Data Extractor based on artificial intelligence technology. It is the first scraper to support both Windows, Mac and Linux operating systems.
Introduction to the scraping object
Tumblr is a microblogging and social networking website founded by David Karp in 2007, and owned by Oath Inc. The service allows users to post multimedia and other content to a short-form blog. Users can follow other users’ blogs. Bloggers can also make their blogs private.
Official Website: https://www.tumblr.com/
Scraping fields
User, title_link, Note, Tag, Image, Content
Function point directory
Preview of the scraped result
Export to Excel2007:

1. Download and install ScrapeStorm, then register and log in
(1) Open the ScrapeStorm official website, download and install the latest version.
(2) Click Register/Login to register a new account and then log in to ScrapeStorm.

Tips: You can use this web scraping software directly, you don’t need to register, but the tasks under the anonymous account will be lost when you switch to the registered user, so it is recommended that you use it after registration.
2. Create a task
(1) Copy the URL of Tumblr

Click here to learn more about how to enter the URL correctly.


(2) Create a new smart mode task
You can create a new scraping task directly on the software, or you can create a task by importing rules.
Click here to learn how to import and export scraping rules.

3. Configure the scraping rules
(1) Manually select
If you are not satisfied with the automatically recognized data or the effect of recognition is not good, you can manually select the list on the page.

(2) Set the fields
Intelligent mode automatically recognizes the fields on the page. You can right-click the field to rename the name, add or delete fields, modify data, and so on.
Click here to learn how to how to configure the extracted field.

Add or remove fields as needed, and rename the fields. The results of the field settings are as follows:

(3) Manually set the page
Some web pages have special buttons on the next page, and the system may not recognize them. In this case, you need to manually set the page to “Scroll to Load”.
Click here to learn how to manually select the page.

4. Set up and start the scraping task
(1) Running and Anti-block settings
Click “Setting”, set waiting time based on web page open speed. You can check “Block Images” and “Block Ads”. The anti-block settings follow the system default settings. Then click “Save”.
Click here to learn more about how to configure the scraping task.


P.S. “Block Images” will reduce the load time and speed up the scraping process. And this operation does not affect the scraping and downloading of images.
(2) Start scraping data
Premium Plan and above users can use “Scheduled job” and “Sync to Database”. If you want to download images, you can check “Download images while running”. Then click “Start”.
Click here to learn about scheduled job.
Click here to learn about sync to database.
Click here to learn about download images.

(3) Wait a moment, you will see the data being scraped.

5. Export and view data
(1) Click “Export” to download your data.

(2) Choose the format to export according to your needs.
ScrapeStorm provides a variety of export methods to export locally, such as excel, csv, html, txt or database. Professional Plan and above users can also post directly to wordpress.
Click here to learn more about how to view the extraction results and clear the extracted data.

Click here to learn more about how to export the result of extraction.


评论

发表评论

此博客中的热门博文

Web scraping products from Amazon using ScrapeStorm

图片
In this article, we will tell you how to scrape products from Amazon using ScrapeStorm’s “ Flowchart mode “. Introduction to the scraping tool ScrapeStorm (www.scrapestorm.com) is a new generation of  Web Scraping Tool  based on artificial intelligence technology. It is the first scraper to support both Windows, Mac and Linux operating systems. Introduction to the scraping object Amazon.com, Inc., doing business as Amazon, is an American electronic commerce and cloud computing company based in Seattle, Washington, that was founded by Jeff Bezos on July 5, 1994. Official Website: https://www.amazon.com/ Scraping fields title, title_link, Thumbnail, brand, rating, price, review Function point directory What is a Behavior Component Introduction to the function points of the “Loop” component How to use the “Extract Data” component How to manually select paging Preview of the scraped result Export to Excel2007: Export images to local: ...
阅读全文

What each programming language can do？

  Many people always start learning programming by searching for resources on the Internet after their brains are hot. When I started learning, what I was learning wasn’t what I liked the most, and it seemed like I liked another technology more. Before we learn a programming language, we have to figure out what areas it applies to. This article describes the application areas of some programming languages and sees what they can do. 1. C language C’s main application areas are operating systems, embedded systems, and servers, and it is a powerful high-level language that is widely used underneath. For example, Microsoft’s Windows system, which accounts for over 90% of the world’s operating systems, is written in C at its core. However, the C language is notoriously difficult to learn, and if you are familiar with the C language, the income is not low. 2. Java Java is mainly used for enterprise-level application development, website platform development, mobile games and Android deve...
阅读全文

Extract stcok data from TradingView with ScrapeStorm

图片
In this article, we will tell you how to scrape stock data from TradingView using ScrapeStorm’s “ Smart mode “. Introduction to the scraping tool ScrapeStorm is a new generation of software for  web scraping  based on artificial intelligence technology. It is the first scraper to support both Windows, Mac and Linux operating systems. Official website→ http://www.scrapestorm.com/ Introduction of scraping objects TradingView is an advanced financial visualization platform that is the most active social network for traders and investors. Talk to millions of traders from all the world, discuss trading ideas and place live orders. Official website: https://www.tradingview.com/ Scraping fields TICKER, title_link, CLOSE, CHG %, CHG, RATING, VOL, MKT CAP, P/E, EPS(TTM), EMPLOYEES, SECTOR scraping time Function point directory How to manually set the page Preview of the scraped result Export to Excel2007: Let’s take a closer look at...
阅读全文