Batch Data Scraping (win) ​

Function Description ​

TIP

Scrape batch data from the target window, commonly used for scraping list pages, detail pages, and multi-page data by setting the pagination button.

Configuration Item Description ​

General ​

Command Input

  • Window ObjectTWinObj: Enter the window object

  • Operation TargetTTarget: Table element to be scraped

  • Number of Pages to ExtractInteger: Choose how many pages of data to extract

  • Next Page ButtonTTarget: Pagination element

  • Number of PagesInteger: Maximum pages to scrape

  • Save to Data TableBoolean: Whether to save the results to a data table

Command Output

  • Save Batch Data toTDataTable: Save the retrieved batch data to a table

Advanced ​

  • Custom Column Namestring: Custom column names, separated by commas.

  • Page Turn Interval (milliseconds)Integer: Interval between page turns

  • Simulate Manual Click on Next Page ButtonBoolean: Simulate a manual click event

  • Send Window MessagesBoolean: Send window messages to trigger the click

  • Automatically Scroll to the Bottom of the PageBoolean: Automatically scroll to load the page before scraping, can be disabled

  • Simulate Page Turn DelayBoolean: Simulate the delay during a real person's page turn

  • Minimum Delay Duration (milliseconds)Integer: Shortest wait time after execution

  • Maximum Delay Duration (milliseconds)Integer: Longest wait time after execution

  • Delay Before(milliseconds)Integer: The waiting time before instruction execution

  • TimeOutInteger:

Error Handling ​

  • Print Error LogsBoolean: Whether to print error logs to the "Logs" panel when the command fails. Default is checked.

  • Handling MethodInteger:

    • Terminate Process: If the command fails, terminate the process.

    • Ignore Exception and Continue Execution: If the command fails, ignore the exception and continue the process.

    • Retry This Command: If the command fails, retry the command a specified number of times with a specified interval between retries.

Usage Example ​

Process logic description:

Common Errors and Handling ​

None

Frequently Asked Questions ​

None