Welcome to the Ali2Woo Reviews Scraper. This tool, aw-scraper.py , allows you to scrape product reviews from AliExpress and associate them with products on your WooCommerce store. By using this scraper, you can enrich your WooCommerce product pages with genuine customer reviews from AliExpress, enhancing the credibility and attractiveness of your products.

Features

• Scrapes reviews from AliExpress for specified product IDs.
• Associates scraped reviews with corresponding WooCommerce product IDs.
• Supports headless browsing using Selenium with the Gecko driver.
• Extracts review content, rating, date, user display name, and media links.
• Saves scraped reviews into CSV files for easy import into WooCommerce.

Prerequisites

Before running the scraper, ensure you have the following installed:

1. Python:
   • Install Python from the official website.
   • We recommend using the Spyder IDE for an enhanced development experience. Download Spyder from the official website.
2. Firefox Browser:
   • Download and install Firefox from the official website.
3. GeckoDriver:
   • Download the appropriate version of GeckoDriver for your operating system from the GeckoDriver releases page.
   • Ensure the GeckoDriver executable is placed in the driver/firefox/ directory relative to the script or update the path in the script accordingly.
4. Selenium (latest version):
   • Install Selenium using pip: pip install selenium
5. BeautifulSoup (latest version):
   • Install BeautifulSoup using pip: pip install beautifulsoup4
6. Product List CSV:
   • Prepare a CSV file named product_list.csv with the following columns:
     • ali_Id : The AliExpress product ID.
     • woo_Id : The corresponding WooCommerce product ID.

Usage

To run the scraper, execute the following command in your terminal: python3 aw-scraper.py

The script will read the product_list.csv file, scrape the reviews for each AliExpress product ID, and save the reviews in a CSV file named in the format auto-scraped/{woo_Id}_reviews.csv . If no reviews are found for a product, an empty CSV file named auto-scraped/{woo_Id}_reviews_skipped.csv will be created.

How It Works

1. Reading Product List: The script reads the product_list.csv file to get the list of AliExpress and WooCommerce product IDs.
2. Scraping Reviews: For each product, it navigates to the AliExpress reviews page using Selenium in headless mode, scrapes the reviews, and extracts relevant data using BeautifulSoup.
3. Saving Reviews: The extracted reviews are saved into CSV files, which can be easily imported into WooCommerce.

Example Output

After running the script, you will find the following files in the auto-scraped/ directory:

• For products with reviews: {woo_Id}_reviews.csv
• For products without reviews: {woo_Id}_reviews_skipped.csv

Each review CSV file will contain the following columns:

• review_content : The text of the review.
• review_score : The rating given by the user (1-5 stars).
• date : The date of the review.
• product_id : The WooCommerce product ID.
• display_name : The display name of the reviewer.
• email : A placeholder email address for the reviewer.
• order_id : Currently set to None .
• media : Links to any media (images) included in the review.

Support

If you encounter any issues or have questions, please use our contact us page