
Closed
Posted
Paid on delivery
I want to scrape all legal text from EUR LEX (url here: [login to view URL]). The count is about a million documents. For every document please: • Download the official PDF in its original layout. • Pull the full plain text in BOTH English (EN) and German (DE). • Generate a companion JSON file per document containing: – document_id (as it appears in the URL), – year, – raw_text_en, – raw_text_de, – pdf_file_name set exactly to “<document_id>.pdf”. Folder structure can be simple—one directory that holds each PDF and its matching JSON with identical IDs. Accuracy matters because the data feeds directly into a research pipeline, so please handle character encoding and long parliamentary tables correctly. A lightweight Python solution using requests/BeautifulSoup or Scrapy is perfect; headless Selenium is fine if needed for dynamic pages. All code, a brief README, and any [login to view URL] must be included so I can reproduce the run locally. Once the script finishes, send the ZIP containing: 1. Source code. 2. The PDFs. 3. All JSON files. No ongoing schedule is required—just this single extraction.
Project ID: 40147242
47 proposals
Remote project
Active 4 mos ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
47 freelancers are bidding on average $147 USD for this job

With my skill set and experience, I am the perfect candidate to handle this ambitious project. As an expert in data extraction using Python, I am well acquainted with the libraries you mentioned; BeautifulSoup and Scrapy would be an ideal choice for scraping a source like EUR LEX. Not only am I proficient in handling character encoding and complicated table structures, but I also place a high premium on accuracy, which is crucial for your research pipeline. Throughout my career, I've consistently delivered comprehensive solutions while ensuring performance and scalability. This means not only will I provide a clean dataset with all necessary metadata but my solution will also be easy to reproduce independently. My structured approach to building software includes code that is easily readable and includes a thorough README file. As a top percentile freelancer on the platform, my commitment to excellence has been recognized by past clients. Let me bring that dedication to your project. By entrusting it with me, you can be assured of timely delivery not just of the scraped text and companion JSONs, but a well-organized ZIP file including all relevant files as you required.
$300 USD in 7 days
6.1
6.1

As a seasoned Full-Stack Developer with extensive experience in Python and JavaScript, I am eager to offer my expertise for your EUR-Lex Text & PDF Scraper. Your project aligns perfectly with my Web Scraping skills using requests/BeautifulSoup or Scrapy, venturing beyond the simple data retrieval process to construct a meaningful JSON structure that befits your research needs. Throughout my six-year career, I have always emphasized the highest level of accuracy, particularly when it comes to handling character encoding and parsing complex tables like parliamentary text. My proficiency in headless Selenium will also come in handy for handling dynamic pages and ensuring comprehensive data extraction. Not compromising on quality is my utmost priority because I understand that your research pipeline hinges on the flawlessness of the data I provide. Finally, the clean code, comprehensive GitHub portfolio, proven track record of seamless communication, and timely updates I bring to the table ensure a smooth project collaboration. By choosing me, you'll not only get the desired deliverables in a meticulous ZIP package but also an organized folder structure and all necessary documentation for easy replication locally. Let's work together to transform your vision into vibrant reality, leveraging efficient Python solutions for your data mining requirements!
$140 USD in 7 days
6.2
6.2

Hello I can deliver a precise one-off Python extraction that downloads each EUR-Lex PDF, accurately pulls full EN and DE plain text with correct encoding and table handling, generates matching per-document JSON files, and packages all source code, outputs, requirements, and a clear README in a reproducible ZIP. Regards Muhammad
$100 USD in 1 day
5.2
5.2

As an experienced freelancer with a breadth of skills and knowledge, I am confident in my ability to accomplish this task to an exceptional standard. Being skilled in JavaScript and Python, I am well-versed with web scraping techniques and generally use popular frameworks such as Beautiful Soup and Scrapy. However, with the scale of this project, I would recommend using a more robust framework like Scrapy to ensure the scraping process is as efficient as possible. Should the need arise, I have no issue utilizing Selenium for handling the dynamic pages. Moreover, my expertise extends beyond just web scraping. As a data scientist with an Amazon Web Services certification under my belt, I can confidently claim that I have a profound understanding of managing large-scale data pipelines and processing vast amounts of information accurately. Additionally, I believe my experience with character encodings and handling complex document layouts will prove essential for the EUR-Lex text extraction. In conclusion, what sets me apart from other freelancers is not only my technical skills but also my adherence
$150 USD in 3 days
4.8
4.8

Hi there, I have 7+ years of experience in JavaScript, Web Scraping, Scrapy and can deliver a clean, reliable solution for your project. I value clear communication and timely delivery, and I’m ready to get started immediately. Let’s connect and discuss your goals. Best regards, Dorian
$140 USD in 1 day
3.6
3.6

Dear [Client], I am Aurallian, and I specialize in web scraping for structured data extraction. I propose to handle your EUR-Lex PDF and text extraction project using Python, BeautifulSoup, or Scrapy for accurate data retrieval, including handling character encoding and complex tables. I will organize the output in a clear folder structure containing PDFs and JSON files for seamless integration into your research pipeline. Upon completion, I will provide all source code, PDFs, and JSON files in a ZIP file for easy access. Let's discuss further steps or any adjustments you need. Looking forward to working together. Best regards, Aurallian
$150 USD in 14 days
3.0
3.0

Hello, I have real experience building large-scale web scrapers for legal and research datasets. I can extract all EUR-Lex documents, download official PDFs, and reliably parse full plain text in both EN and DE with correct encoding and table handling. I’ll deliver a clean Python solution (requests/Scrapy, Selenium if required) that generates one PDF + matching JSON per document, plus a reproducible README and requirements. Thanks!
$80 USD in 2 days
3.0
3.0

Hi there, I can handle this large-scale extraction for you. With my expertise in Python, Web Scraping, and Data Wrangling, I have the technical capability to build a robust solution capable of processing ~1 million EUR-Lex documents with high accuracy. My Technical Approach: Stack: I will use Scrapy (Python), as it is the industry standard for large-scale scraping. It handles concurrency and retries much better than simple scripts, ensuring we get all 1 million documents. Data Precision: I will use BeautifulSoup and Pandas to parse the HTML, correctly handling UTF-8 encoding and complex parliamentary tables to ensure the Plain Text (EN/DE) is accurate. Deliverables: I will structure the output exactly as requested—individual PDFs and accompanying JSON files—and package everything into a ZIP for delivery. Quality Assurance: I understand this data feeds into a research pipeline. I will implement rigorous error handling and logging to ensure no data is corrupted and character sets are preserved perfectly. I am ready to build the reproducible script and manage the extraction process. Do you have a preference for the file naming convention beyond the ID? Best regards, Alhaitham Gamal Python Developer & Data Scraping Specialist
$220 USD in 1 day
3.1
3.1

Hello, I'm excited about the opportunity to assist you with the EUR-Lex text and PDF extraction project. With extensive experience in web scraping and data extraction using Python, I can efficiently handle your specific requirements. I will utilize libraries such as requests, BeautifulSoup, and possibly Scrapy to ensure accurate character encoding and that long parliamentary tables are processed correctly. Given the importance of accurate data for your research pipeline, I will ensure each PDF is downloaded in its original layout and all necessary JSON files are generated per your specifications. After completing the extraction, I'll package everything in a ZIP file for your convenience, including a clear README documentation to guide you through local reproduction. I can have this ready for you within 4 days. Do you have any preferred tools or additional specifications for the folder structure? Best regards, Sadam
$180 USD in 5 days
2.5
2.5

THIS IS NOT AN AUTO/AI BID!! (Read it once) Hey, I have carefully reviewed your project and fully understand the requirement to perform a one-off extraction of EUR-Lex documents while maintaining perfect accuracy and structure. I can develop a robust Python solution using requests and BeautifulSoup, or Scrapy, with headless Selenium for any dynamic pages to reliably download PDFs, extract plain text in English and German, and generate precise JSON files with document IDs, years, texts, and file names. I will ensure proper handling of character encoding and complex tables to maintain the integrity of your research data. The folder structure will be clean, with matching PDFs and JSONs, and I will provide a fully reproducible package including source code, README, and requirements.txt. I am genuinely excited to deliver this project efficiently and with meticulous attention to detail. Best Regards, Hamza Javed
$200 USD in 3 days
2.4
2.4

Hi, I specialize in automation and data extraction and have completed many scraping and integration projects with consistently strong reviews. I’m confident I can build this Pipedrive → Google Sheets automation quickly, accurately, and in a maintainable way. I focus on clean data mapping, reliability, and clear documentation so the solution works long-term, not just once. Please feel free to review my past work and contact me — I’m ready to start immediately.
$90 USD in 1 day
2.5
2.5

Hi, I’m Mst Habiba Hasan, I am a Senior Full-Stack Developer with more than 10 years of experience. I can help you with: — Website development — Mobile app development — Web app development — Backend development — AI and Machine Learning development — Maintenance of existing projects — UX/UI design — Browser extensions — DevOps — Solution Architecture — Consulting — MVP development Technologies I've worked with include but are not limited to: * Python/ Django * ReactJS / React Native (including React Native Web) / Expo / Express / Redux / NextJS * Javascript / Typescript / Flow types * NodeJS / Angular / Vue.js * MongoDB / SQL (MySQL / MariaDB / PostgreSQL) / Redis * OAuth2 / Keycloak / Auth0 / Cognito * Kubernetes / Helm / Docker / Ansible / Terraform / Amplify / Firebase * AWS / Azure / GCP / on premises * RESTful / GraphQL / OpenTracing / AMQP (RabbitMQ) Contact me today to get started! I’m excited to collaborate and bring your vision to life. Best regards, Mst Habiba Hasan
$40 USD in 3 days
3.5
3.5

Hello, I have strong experience building large-scale, reproducible data extraction pipelines for legal and regulatory datasets, including multilingual EU and government sources. I understand the importance of accuracy, encoding integrity, and faithful document reproduction when data feeds directly into downstream research or NLP pipelines. For this project, I will design a robust Python-based scraper specifically adapted to EUR-Lex’s structure and access patterns. I will also flag any practical constraints early (rate limits, volume size, storage considerations) and ensure the extraction is legally compliant with EUR-Lex access policies. This is well-suited for a single, one-time extraction, and I can optimize for either maximum throughput or maximum textual fidelity depending on your downstream needs. Best regards,
$140 USD in 7 days
1.6
1.6

Hey , I just finished reading the job description and I see you are looking for someone experienced in Python, JavaScript, Scrapy, BeautifulSoup, Data Extraction, Software Architecture, Web Scraping and Selenium. This is something I can do. Please review my profile to confirm that I have great experience working with these tech stacks. While I have few questions: 1. These are all the requirements? If not, Please share more detailed requirements. 2. Do you currently have anything done for the job or it has to be done from scratch? 3. What is the timeline to get this done? Why Choose Me? Deliver high-quality work with a strong focus on accuracy, efficiency, and client objectives. Maintain a proven record of long-term client satisfaction with consistently positive feedback. Earn 5-star ratings on recent projects, reflecting reliability and clear communication. Work with a structured, detail-oriented approach to ensure timely and accurate delivery. Availability: Full-time freelancer with flexible availability and fast response times (Eastern Time). I will share with you my recent work in the private chat due to privacy concerns! Please start the chat to discuss it further. Regards, Hassan.
$30 USD in 2 days
0.0
0.0

Hey , I just finished reading the job description, and I see you are looking for someone experienced in Data Extraction, Software Architecture, BeautifulSoup, JavaScript, Python, Selenium, Scrapy and Web Scraping. This is something I can do. Please review my profile to confirm that I have great experience working with these tech stacks. While I have a few questions: 1. Are all these requirements? If not, please share more detailed requirements. 2. Do you currently have anything done for the job, or does it have to be done from scratch? 3. What is the timeline to get this done? Why Choose Me? 1. I have done more than 250 major projects. 2. I have not received a single bad feedback in the last 5-6 years. 3. You will find 5-star feedback on the last 100+ major projects, which shows my clients are happy with my work. I will share with you my recent work in the private chat due to privacy concerns! Please start the chat to discuss it further. Regards, Kafeel Ahmed.
$155 USD in 1 day
0.0
0.0

Hi there, I see you're looking for someone to scrape EUR-Lex for PDFs and text. I totally got your back on this! With my experience in Python, BeautifulSoup, and Scrapy, I can whip up a lightweight solution that’ll grab those PDFs and text in both English and German, no sweat. Here's the plan: I'll make sure to download the PDFs while keeping their layout intact, pull the raw text, and create the JSON files with the right structure. Plus, I’ll handle any character encoding issues and those tricky parliamentary tables like a pro. You’ll get all the files zipped up and ready to rock. Let’s get this done quick and clean. Looking forward to working with you! Best regards, Uros S
$140 USD in 7 days
0.0
0.0

Hey — saw your post about scraping all legal text from EUR-Lex. The tricky part here is handling pagination, multiple document formats (HTML/PDF), and staying consistent with their structure over thousands of records. Quick question before I suggest an approach: Do you just need the raw text and metadata (titles, CELEX, dates, types), or a more structured JSON/CSV output with fields clearly separated? I’ve built scrapers for large legal and governmental sites before, including PDF text extraction and rate-limit–safe crawling, so I know where these usually break at scale. If you send a short spec with the fields you want extracted and a couple of example URLs, I’ll take a look and tell you the cleanest way to set this up.
$140 USD in 7 days
0.0
0.0

Hi I have full experience in OCR and scrapper tool developing. I can handle this project without issue. Let's talk! Thanks Sayuki
$200 USD in 7 days
0.0
0.0

Here’s a refined and more professional response you can use to update your bid so it clearly reflects your skills and experience: I have hands-on experience with Python-based web scraping and large-scale document processing, with a strong focus on accuracy and reproducibility. I am skilled in extracting multilingual legal text, downloading and preserving original PDF layouts, and structuring clean JSON outputs suitable for research pipelines. I regularly work with tools such as Requests, BeautifulSoup, Scrapy, and Selenium when required. I pay close attention to character encoding, tables, and long-form documents to ensure data integrity. I also provide well-documented, reproducible code with clear folder structures, README files, and dependency lists, ensuring smooth local execution and reliable results.
$110 USD in 5 days
0.0
0.0

This project needs a clean, professional, user-friendly solution with a seamless, integrated experience. I focus on clarity, intuitive structure and making sure every part works smoothly together. no overcomplication - just a reliable, well-thought-out result that feels natural to use and easy to maintain. You require an automated, high-accuracy scraper to download legal PDFs and extract bilingual plain text from EUR LEX, with well-structured JSON metadata and careful encoding for research use. I specialize in Python scraping using requests, BeautifulSoup, and Selenium, ensuring robust handling of dynamic content and complex text extraction. While I am new to freelancer, I have tons of experience and have done other projects off site. Message me today - let's build something that works for your business. Regards, Nadia Du Preez
$200 USD in 14 days
0.0
0.0

Kenya
Member since Jan 7, 2026
$250-750 USD
₹12500-37500 INR
$250-750 USD
₹600-1500 INR
$10-30 USD
₹600-1000 INR
₹750-1250 INR / hour
₹1500-12500 INR
$30-250 USD
$30-250 USD
£10-15 GBP / hour
$10-30 USD
$10-30 USD
$30-250 USD
₹400-750 INR / hour
₹1500-12500 INR
$15-25 CAD / hour
$250-750 USD
₹600-1500 INR
$30-250 USD
₹1500-12500 INR