Py-weblib

Jul 20, 2023

Set of tools for web scraping projects

Weblib provides tools to solve typical tasks in web scraping

  • processing HTML
  • handling text encodings
  • controling repeating and parallel tasks
  • parsing RSS/ATOM feeds
  • preparing data for HTTP requests
  • working with DOM tree
  • working with text and numeral data
  • list of common user agents
  • cross-platform file locking
  • operations with files and directories


Checkout these related ports:
  • Zziplib - Library to provide transparent read access to zipped files
  • Zydis - Fast and lightweight x86/x86-64 disassembler library
  • Zycore-c - Support library with platform independent types, macros, etc for Zydis
  • Zthread - Platform-independent object-oriented C++ threading library
  • Zookeeper - Coordination Service for Distributed Applications
  • Zls - Zig LSP implementation + Zig Language Server
  • Zfp - High throughput library for compressed floating-point arrays
  • Zeal - Offline documentation browser
  • Zapcc - C++ caching compiler based on clang
  • Zanata-platform - Web-based translation platform
  • Zanata-cli - Zanata Java command line client
  • Z88dk - Complete Z80/Z180 development kit
  • Z80ex - ZiLOG Z80 CPU emulator library
  • Z80asm - Assembler for the Z80 microprocessor
  • Z80-asm - Z80 assembly code assembler and disassembler