Best of Selenium — 2024

  1. 1
    Video
    Avatar of TechWithTimTech With Tim·2y

    Python AI Web Scraper Tutorial - Use AI To Scrape ANYTHING

    This post guides you on building an AI-powered web scraper using Python. The scraper can extract information from any website by passing a URL and a prompt to the AI. Essential tools include Streamlit for the front end, Selenium for web scraping, and Langchain for integrating with AI models. Detailed steps cover setting up the environment, handling dependencies, and developing the UI and backend functions necessary for scraping and parsing web content. The tuto­r­ial also explores overcoming common challenges like captchas and IP bans using Bright Data's scraping browser.

  2. 2
    Article
    Avatar of hnHacker News·2y

    Web Scraping in Python - The Complete Guide

    This post provides a comprehensive guide to web scraping in Python, including the advantages of using Python for web scraping, the best Python libraries for web scraping, and some tips and best practices for handling challenges in web scraping. It also includes code examples and recommendations for alternative libraries and tools for web scraping.

  3. 3
    Article
    Avatar of communityCommunity Picks·2y

    Python Web Scraping Made Easy: Explore These 8 Libraries 🔍

    Python is an ideal language for web scraping due to its simplicity and robust ecosystem. This post highlights eight popular Python libraries for web scraping: BeautifulSoup for HTML/XML parsing, Scrapy for creating spiders, Selenium for browser automation, Requests for handling HTTP requests, LXML for efficient XML/HTML processing, PyQuery for jQuery-like querying, MechanicalSoup for browser emulation, and Playwright for cross-browser automation. Each library has unique features catering to various scraping needs.

  4. 4
    Article
    Avatar of lambdatestLambdaTest·2y

    How to Automate WhatsApp Messages Using Python

    Learn how to automate WhatsApp messages using Python and Selenium. Automating WhatsApp messages can bridge communication gaps, automate notifications, and create a seamless flow of information in test scenarios. Python and Selenium offer versatility, user-friendliness, and strong capabilities for automating WhatsApp messages effectively. Consider using Pywhatkit or Twilio API for WhatsApp, or explore other Python libraries like yowsup, WhatsAPIDriver, and WhatsAPI for automation. Best practices include being aware of WhatsApp's terms, ensuring user privacy and data security, handling errors and exceptions, scheduling messages, understanding rate limits, staying updated with WhatsApp's policies, and maintaining and updating libraries. By following these best practices, you can ethically and successfully automate WhatsApp messages using Python.

  5. 5
    Video
    Avatar of youtubeYouTube·2y

    This Open Source Scraper CHANGES the Game!!!

    An open-source application is capable of scraping data from any website using just the URL and specified data fields, presenting the extracted information in formats like JSON, Excel, and Markdown. The tool leverages GPT models for cost-efficient operations and can handle intricate tasks such as CAPTCHA navigation and infinite scrolling. It avoids using libraries like fire craw for more control but still ensures reliable data extraction through structured output models from OpenAI.

  6. 6
    Article
    Avatar of lambdatestLambdaTest·2y

    How To Write a Test Cases in Java

    Writing test cases in Java is essential for ensuring code reliability and robustness. This guide covers fundamental concepts like the importance of test cases, locating WebElements, and setting up a project using Maven and Eclipse IDE with TestNG and Selenium frameworks. It also explains structuring the tests, setting up and tearing down WebDriver instances, and executing tests both locally and on the LambdaTest cloud platform. Additionally, best practices for writing test cases are provided to help make your tests maintainable and reliable.

  7. 7
    Article
    Avatar of earthlyEarthly·2y

    Python Web Scraping with Beautiful Soup and Selenium

    Learn how to scrape websites with Python using Beautiful Soup and Selenium. Extract data from static pages with Beautiful Soup and navigate dynamic pages with Selenium.

  8. 8
    Article
    Avatar of lambdatestLambdaTest·2y

    8 Useful pytest Plugins for Python Automation

    Explore eight useful pytest plugins that can enhance your Python automation testing processes. These plugins include pytest-check for advanced assertions, pytest-bdd for BDD integration, pytest-xdist for parallel test execution, pytest-randomly for random test order, pytest-html for HTML reports, pytest-datafiles for external data file integration, pytest-cov for code coverage reports, and pytest-mock for managing mocks. Learn how to install each plugin and see examples of how they can optimize your testing workflow.

  9. 9
    Video
    Avatar of coreymsCorey Schafer·2y

    Automating My Bill Payments with Python and Selenium

    Learn how to automate bill payments using Python and Selenium. The author shares a real-world example of automating bill payments using a Python script that takes advantage of various skills and techniques such as navigating web browsers, automating form filling, logging, and sending email and text notifications.

  10. 10
    Article
    Avatar of hnHacker News·1y

    mherrmann/helium: Lighter web automation with Python

    Helium is a Python library that simplifies web browser automation for Chrome and Firefox, offering a high-level API that shortens and stabilizes scripts by enabling element identification through user-visible labels. It seamlessly integrates with Selenium and includes additional functionalities like easier iFrame interaction, window management, and implicit waits. The author highlights the open-source nature of the project, encourages contributions, and provides steps for getting started and conducting tests.

  11. 11
    Article
    Avatar of communityCommunity Picks·2y

    7 Best Test Automation Tools to Supercharge Your Software Testing Efficiency

    Test automation is crucial for enhancing the speed, accuracy, efficiency, and cost-effectiveness of software testing. By automating repetitive tasks, it allows human testers to focus on more complex responsibilities. Popular tools like Keploy, Katalon, Selenium, Appium, TestComplete, Cypress, and Siege each offer unique features suitable for various aspects of testing, including web, mobile, API, and performance tests.

  12. 12
    Article
    Avatar of hnHacker News·1y

    steel-dev/steel-browser: 🚧 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser instance that lets you build automate the web without worrying about infrastructu

    Steel.dev is an open-source browser API that allows developers to build AI apps and agents for web interaction without building automation infrastructure from scratch. It offers full browser control, session management, proxy support, debugging tools, and more. The API supports popular frameworks such as Puppeteer, Playwright, and Selenium, and can be run locally or deployed to various cloud platforms. The project is in public beta and invites contributions and feedback.

  13. 13
    Article
    Avatar of lobstersLobsters·2y

    Why Playwright is less flaky than Selenium

    Playwright is considered less flaky than Selenium because its speed forces correct UI test writing from the start. Selenium's slower performance can allow race conditions to pass undetected, leading to erratic test failures. Switching to Playwright may reveal pre-existing issues in tests, which is beneficial for writing more reliable tests.

  14. 14
    Article
    Avatar of hnHacker News·2y

    lavague-ai/LaVague: Automate automation with Large Action Model framework

    LaVague is a framework designed to automate menial tasks on behalf of users by transforming natural language instructions into seamless browser interactions. It is built on open-source projects, integrates with Selenium, and supports local models for privacy and control.

  15. 15
    Article
    Avatar of lambdatestLambdaTest·1y

    Selenium Python Tutorial : A Python Automation Testing Guide with examples

    Learn how to automate web browsers using Selenium and Python with this comprehensive guide. The tutorial covers installation steps, configuring Selenium with Python, setting up projects, running automated tests on local and cloud grids, handling keyboard and mouse actions, interacting with dropdowns, radio buttons, checkboxes, alerts, and iFrames, and more. Ideal for those seeking to enhance their web testing skills.

  16. 16
    Video
    Avatar of oxylabsOxylabs·2y

    Playwright vs Selenium: Which One to Choose

    Selenium and Playwright are two popular web automation frameworks used for web scraping and testing. Selenium supports a wide range of programming languages and browsers but requires individual WebDriver installations. On the other hand, Playwright, although supporting fewer languages and browsers, offers an easier implementation and faster performance due to its modern architecture and built-in drivers. Both tools have their own strengths, making Selenium suitable for flexibility and extensive community support, while Playwright is best for simpler and quicker implementations.

  17. 17
    Article
    Avatar of lambdatestLambdaTest·2y

    How To Generate Pytest Code Coverage Report

    Code coverage measures how much of an application's source code is exercised by tests, typically expressed as a percentage. Using the pytest framework, developers can generate detailed code coverage reports using tools like coverage.py and pytest-cov. These tools provide various reporting options, such as HTML or XML, and support extensive customization. Achieving high code coverage helps identify untested code, minimizing the risk of undetected bugs. Walkthroughs and examples demonstrate how to set up and execute tests for comprehensive code coverage, even on cloud-based platforms like LambdaTest.

  18. 18
    Article
    Avatar of lambdatestLambdaTest·2y

    16 Selenium Best Practices For Efficient Test Automation

    This post provides 16 Selenium best practices for efficient test automation. It covers topics such as avoiding blocking sleep calls, naming test cases appropriately, setting the browser zoom level to 100 percent, using the best-suited web locator, implementing logging and reporting, using design patterns like Page Object Model (POM), and leveraging parallel testing in Selenium. The post also includes a list of worst practices to avoid in automation testing with Selenium.

  19. 19
    Article
    Avatar of habrhabr·2y

    How to bypass reCAPTCHA V2/V3 using code and another way

    The post details various methods to bypass Google's reCAPTCHA using programming languages like Python, JavaScript, and PHP. It discusses the evolution of reCAPTCHA from V1 to V3 and introduces different modules and tools that can solve these CAPTCHA challenges. The post provides code examples and highlights the use of automation tools such as Selenium to ease the bypassing process.

  20. 20
    Article
    Avatar of communityCommunity Picks·2y

    What are the best Python web scraping libraries?

    Explore the best Python web scraping libraries and frameworks, including HTTP libraries like Requests and HTTPX, Beautiful Soup for HTML parsing, Selenium and Playwright for browser automation, and Scrapy for complex scraping jobs. Each library has its own pros and cons, so it's important to choose the one that best fits your project's needs.

  21. 21
    Article
    Avatar of mlnewsMachine Learning News·2y

    LaVague’s Open-Sourced Large Action Model Outperforms Gemini and ChatGPT in Information Retrieval: A Game Changer in AI Web Agents

    LaVague is an open-sourced framework that simplifies the creation and deployment of AI agents for information retrieval. It offers powerful capabilities and easy integration with private data sources. LaVague aims to revolutionize AI-driven automation and encourages community participation and sharing.

  22. 22
    Article
    Avatar of communityCommunity Picks·2y

    Chrome's Headless mode gets an upgrade: introducing --headless=new

    Chrome's Headless mode has been upgraded with the introduction of --headless=new. The new version unifies Headless and headful modes, removing limitations and bugs of the old implementation. Developers can try out the new Headless mode using the `--headless=new` flag. The new mode supports various command-line flags like `--dump-dom`, `--screenshot`, and `--print-to-pdf`. To debug Headless Chrome, the `--remote-debugging-port` flag can be used.

  23. 23
    Article
    Avatar of jetbrainsJetBrains·2y

    Learn to Test Software Automatically with Selenium and Python

    Learn to test software automatically with Selenium and Python. The course covers automated testing, its importance, and provides access to the course on JetBrains Marketplace.

  24. 24
    Article
    Avatar of lambdatestLambdaTest·2y

    How to Handle Hidden Elements in Selenium WebDriver

    Learn how to handle hidden elements in Selenium WebDriver. Discover what hidden elements are, how to access them using JavaScriptExecutor, and avoid exceptions while interacting with them. Also, find answers to frequently asked questions about hidden elements in Selenium.

See all Selenium archives