
Suljettu
Julkaistu
I need two focused Python utilities that help me keep both of my data platforms tidy by flagging objects that haven’t been touched in X days and suggesting safe-to-drop SQL. Program #1 – AWS Athena • Connect to my Athena catalog (I work from the AWS Management Console, but in code I’d like you to stay with boto3). • For every table and view in a specified database, look back over completed query executions for the chosen time window. • Views can nest CTEs or reference other views, so the script must walk the full dependency chain to decide whether a reference is direct or indirect. • Return one CSV with the following columns exactly: database , objectname, objecttype, last_reference_datetime, referencetype (direct/indirect) , referencedBy, RemovalSql – referencedBy is the QueryExecutionId when the object is called directly, otherwise the object that called it. – RemovalSql is only populated when the object is demonstrably unused (no direct or indirect reference in the window) so I can drop it immediately. Program #2 – Microsoft SQL Server • Query Store is already enabled, so use it to pull execution history. • Scan tables, views, stored procedures, triggers, queues, and functions. • Produce the very same CSV layout described above, with last_reference_datetime generated from Query Store data and RemovalSql included only when safe. Both scripts should accept command-line parameters for: – target database / connection information – look-back period in days – output file path I’m happy with standard libraries plus boto3 for the Athena side; choose whichever light dependencies you need for SQL Server (pyodbc, sqlalchemy, etc.). Code should be clean, well-commented, and ready to run from the terminal. Deliverables 1. Two independent .py files. 2. A brief README explaining prerequisites, setup, and examples of running each script. 3. Sample output CSVs from a dry-run (anonymised data is fine) so I can verify column order and content. Acceptance criteria • Scripts run without modification once credentials are supplied. • CSV headers and field ordering exactly match specification. • Objects with any level of recent reference are never assigned a RemovalSql. • Indirect references are accurately traced. I’m looking for efficient, reliable code that I can schedule regularly, with clear logging so future troubleshooting is straightforward.
Projektin tunnus (ID): 40269816
27 ehdotukset
Etäprojekti
Aktiivinen 4 päivää sitten
Aseta budjettisi ja aikataulu
Saa maksu työstäsi
Kuvaile ehdotustasi
Rekisteröinti ja töihin tarjoaminen on ilmaista
27 freelancerit tarjoavat keskimäärin ₹991 INR/tunti tätä projektia

Hi there, I’ve carefully reviewed your project requirements, and with my extensive experience in developing Python scripts and applications, I’m confident that I can deliver a high-quality solution tailored to your needs. Whether it’s automation, data processing, or custom application development, I have the skills to ensure your project’s success. I’d love to discuss how I can contribute and help bring your vision to life. Feel free to check out my portfolio for more examples of my work: Portfolio: https://www.freelancer.com/u/webmasters486 Looking forward to hearing from you! Best regards, Muhammad Adil
₹2 000 INR 40 päivässä
6,2
6,2

Hello there, we are a team of developers and experts in Python, Database management. Please, award me to start the work. Thanks Ashish Kumar.
₹1 000 INR 40 päivässä
5,5
5,5

1. I am an expert in Python, Machine Learning, Data Analysis, R programming, R markdown as well. I have done many projects in Data mining and Machine learning projects. I have handled many data analysis part using R, Python based on the project requirement. I provide codes, writing reports as well. 2. Have done many projects. I read your project and sure I can handle your project. 3. Your project will be delivered on time with high standard 4. Assistance will be provided with number of clarifications until client satisfaction 5. I will provide assistance even after the payment. And will maintain data (content) security.
₹1 000 INR 40 päivässä
5,8
5,8

Hello, With over four years of Python backend development, I understand the need for precise, repeatable database hygiene. My approach will be: 1) Build a reusable Athena module that queries CloudWatch logs for the last X days, walks view dependencies via catalog metadata, and records direct and indirect references. 2) Create a SQL Server module that pulls Query Store history, maps all objects, and traces nested calls. 3) For each script, generate a CSV with the exact columns requested, populate RemovalSql only when no reference exists, and log each step for auditability. 4) Package both tools as standalone .py files, supply a README with environment setup and example commands, and provide sample CSVs from a dry‑run. 5) Finally, test end‑to‑end and hand over code ready for scheduled execution. I am ready to start immediately—let's keep your data platforms lean and compliant. Best Regards Naveen Thakur
₹750 INR 1 päivässä
5,2
5,2

Hello, I can audit your Python scripts to identify and clean up unused objects, variables, functions, imports, and dead code to improve readability and performance. I’ll deliver a clean report with actionable fixes and optimized code. Regards, Bharti
₹1 000 INR 40 päivässä
2,2
2,2

I understand you require two Python scripts to audit unused database objects in AWS Athena and Microsoft SQL Server, with precise tracking of direct and indirect references and safe-to-drop SQL generation. Your need for clean CSV output with exact columns, command-line parameters for flexibility, and clear logging for maintainability is clear. With over 15 years of experience and more than 200 projects completed, I specialize in Python development, database design, and AWS cloud services. I’ve built automation tools interfacing with AWS SDKs like boto3 and handled complex SQL Server integrations using pyodbc and SQLAlchemy, ensuring reliable data processing and audit workflows. I will develop two standalone scripts that use boto3 to query Athena’s execution history and Query Store data for SQL Server, carefully resolving nested view dependencies and tracking object usage within the look-back period. Both scripts will generate the specified CSV format with exact headers and removal logic, accompanied by a README and sample output. Expect a functional delivery within one week, ready to run from the terminal with minimal setup. Feel free to share any additional details or questions so we can align perfectly on your requirements.
₹825 INR 7 päivässä
2,0
2,0

Hi, I can develop two Python utilities that analyze AWS Athena and SQL Server objects for recent usage, flag unused items, and generate safe-to-drop SQL, exactly as specified. Both scripts will accept command-line parameters for target database, look-back period, and output path. Athena dependencies will rely on boto3, while SQL Server can use pyodbc or SQLAlchemy. Scripts will trace direct and indirect references, ensure accurate RemovalSql only for unused objects, and produce a CSV with the precise headers you outlined. .......... Deliverables .......... • Two independent Python scripts: Athena cleanup and SQL Server cleanup • Fully commented, terminal-ready code with CLI parameters • README with setup, prerequisites, and execution examples • Sample anonymized CSVs demonstrating correct column order and reference tracking .......... Tech Stack .......... • Python 3. standard libraries • boto3 for AWS Athena • pyodbc / SQLAlchemy for SQL Server • pandas for CSV generation and data handling Visit my profile to see my experience building reliable, production-ready Python automation for databases. Scripts will be efficient, schedulable, and fully compliant with your logging and accuracy requirements.
₹750 INR 40 päivässä
1,0
1,0

Hello, I can deliver two well-structured, production-ready Python utilities for AWS Athena and Microsoft SQL Server that accurately identify unused database objects and generate safe-to-drop SQL only when appropriate. For the Athena utility, I will use boto3 to enumerate tables and views, retrieve completed query executions within the specified look-back period, parse query text, and construct a dependency graph to correctly determine both direct and indirect references. For the SQL Server utility, I will leverage Query Store and system catalog views (via pyodbc or sqlalchemy) to analyze execution history across tables, views, stored procedures, triggers, queues, and functions, ensuring indirect dependencies are properly traced. Both scripts will: Accept command-line parameters for connection details, target database, look-back window (in days), and output file path Generate a CSV with headers and column order exactly as specified Populate RemovalSql only when no recent direct or indirect references exist Include clear logging, modular design, and concise documentation for maintainability Deliverables will include two independent .py files, a brief README with setup and execution examples, and sample anonymized CSV outputs for verification. I look forward to the opportunity to collaborate.
₹850 INR 24 päivässä
0,6
0,6

Hi, This is a well-defined requirement, and I can build both utilities cleanly and reliably. For the Athena script, I’ll use boto3 to: Enumerate tables and views from the specified database Pull completed query executions within the defined look-back window Parse query text to detect direct references Walk dependency chains (including nested views and CTEs) to correctly classify direct vs. indirect references Generate the exact CSV structure you specified, with RemovalSql populated only when zero references are found For the SQL Server utility, I’ll leverage Query Store to: Extract execution history Scan tables, views, procedures, triggers, functions, and queues Trace dependency relationships accurately Produce the identical CSV layout with strict column ordering Both scripts will: Accept command-line parameters (DB details, look-back days, output path) Include structured logging for easy scheduling and troubleshooting Be cleanly modular, well-commented, and production-ready Require only minimal dependencies (boto3 + pyodbc/sqlalchemy as appropriate) Deliverables will include: Two independent .py files A concise README with setup and usage examples Sample anonymized CSV outputs matching your exact header specification I’ll ensure dependency tracing is handled carefully. Happy to discuss edge cases before starting. I can begin immediately. Best regards,
₹1 000 INR 40 päivässä
0,0
0,0

Hi! I am a Data Processing and Google Sheets expert with strong proficiency in Python automation. I can deliver the two cleanup utilities you need to keep your Athena and SQL Server environments tidy. WHY I AM RIGHT FIT : 1. Data Integrity: My background in manual data entry makes me obsessed with accuracy. I will ensure the CSV headers and field ordering exactly match your specification without errors. 2. Technical Implementation: I am experienced with boto3 for AWS automation and pyodbc for SQL Server. I understand how to walk dependency chains to identify indirect references in nested views and CTEs. 3. Clean Outputs: I will provide the RemovalSql only when objects are demonstrably unused, ensuring your database remains safe while becoming more efficient. 4. Reliability: I prioritize clear logging and clean code, making the scripts easy for you to schedule and troubleshoot in the future. I am ready to provide the sample anonymolised CSVs immediately upon start to verify the layout. Looking forward to helping you automate your data platform maintenance. Best regards, Ashish
₹750 INR 40 päivässä
0,0
0,0

Hello, I have completed similar projects outside of Freelancer. Recently, I helped a client automate the cleanup of their AWS Athena and SQL Server environments by flagging unused objects and generating safe-to-drop SQL, saving them hours in manual maintenance. Your need for clean, professional, user-friendly, and seamless utilities that handle nested dependencies and produce exact CSV outputs is crystal clear. I understand how critical it is to have integrated, automated scans that distinguish direct and indirect references accurately. I bring extensive Python expertise with boto3 for Athena and pyodbc for SQL Server. I am doing it at a discounted price because I want good reviews instead of a lot of money, I have tons of experience and have done other projects off site. I would love to chat more about your project! Regards, Steffan Koekemoer
₹950 INR 14 päivässä
0,0
0,0

Hi, I have strong experience in Python scripting and automation. I can develop clean, efficient, and well-structured Python scripts based on your requirements. I have worked on data processing, automation tasks, file handling, and API integrations. I ensure optimized performance, clear documentation, and timely delivery. Please share the detailed requirements, and I can start immediately.
₹1 000 INR 40 päivässä
0,0
0,0

⭐⭐⭐ DATABASE CLEANUP AUTOMATION ⭐⭐⭐ Hi, I understand you need to safely identify and remove unused objects across AWS Athena and MSSQL without breaking dependencies. Your ultimate goal is automated maintenance with zero downtime risk and precise CSV reporting. I will build two robust Python utilities tailored to your schema. ✦ Athena: boto3 to scan QueryExecutionHistory, recursive CTE parsing for view dependencies. ✦ MSSQL: Leverage Query Store for execution stats, system catalogs for dependency trees. ✦ Output: Strict CSV compliance with RemovalSql logic only for objects safe for removal. ✦ Safety: Objects with any recent reference (direct or indirect) will never be flagged for removal. Why I'm the Right Fit: ✦ 7+ years in Data Engineering and SQL optimization. ✦ Extensive experience with AWS Glue, Athena, and MSSQL Query Store. ✦ I write clean, documented code ready for scheduling and logging. ✦ I understand the risk of dropping dependent views and will ensure recursive tracing is accurate. Deliverables: ✦ Two independent .py files (Athena & MSSQL). ✦ README with setup, prerequisites, and usage examples. ✦ Sample anonymized CSVs for verification. Timeline: 1 week. Rate: ₹1,000 INR/hour (within your range). Critical Question: Do your views often use dynamic SQL or temporary tables that might obscure dependency tracking in standard system catalogs? Ready to start immediately. Let's ensure your data platforms remain tidy and performant. Best regards, Kairo
₹1 000 INR 40 päivässä
0,0
0,0

Hi! Python and SQL scripting for database auditing is exactly what I do. For Program #1 (AWS Athena): - I'll use boto3 to connect to your Athena catalog - Query execution history to flag tables/views not touched in X days - Walk dependency chains for views that use CTEs or reference other views - Output a safe-to-drop SQL suggestion report For Program #2 (your second platform): - Same audit logic adapted to that system's API or connection method - Consistent output format so you can run both audits the same way Both scripts will be clean, documented, and easy to re-run whenever you need them. I can also add a configurable X days parameter so you don't need to edit the code each time. Could you tell me what the second platform is? Happy to start as soon as you confirm.
₹900 INR 40 päivässä
0,0
0,0

My name is Laxmi Kaur. I am a Data Analyst fresher and I am passionate about working with data and dashboards. I have hands-on experience in Excel, Power BI, Tableau, SQL Server and Python. I have worked on real-world practice projects such as: McDonald’s sales dashboard in Excel Swiggy dashboard in Power BI Super Sales dashboard in Tableau Coffee shop sales dashboard in Excel I am good at data cleaning, data visualization and finding useful insights from data. I am a quick learner and always ready to improve my skills. I am looking for an opportunity where I can start my career as a Data Analyst and grow with the company.
₹1 000 INR 20 päivässä
0,0
0,0

Hi, I’m Md Shahid Ansari. I’ll build two clean Python utilities that meet your exact CSV layout and logging needs. Using boto3 I’ll walk Athena’s catalog, resolve view dependencies recursively and generate a safe RemovalSql only for objects without direct or indirect references. For SQL Server I’ll query the Query Store via pyodbc/SQLAlchemy, capture usage of tables, views, procedures, triggers and functions and produce the same report. In the past I delivered a Freshness Check System with YOLOv8 and OpenCV, a Finance LLM Translator that turned natural language into MongoDB queries, and an Instagram automation platform built on MERN and Graph APIs—each required precise data handling, SQL/NoSQL integration and robust scripting. I’m comfortable with Python, data analysis, SQL, and database administration, and I’ll add clear comments and a README for easy scheduling. Looking forward to delivering reliable scripts that you can run immediately.
₹750 INR 40 päivässä
0,0
0,0

I have around 20+ years of experience working with lots of tecnologies like C#, ASP.Net, Python, Angular & React and I'm quite comfortable with MySQL, MS SQL & MongoDB. If you want we can have a discussion on your requirements.
₹1 200 INR 40 päivässä
0,0
0,0

Hello, I have strong experience working with Python and MySQL for database analysis and backend systems. I understand that you need a script to audit tables and views by analyzing query execution history and identifying unused database objects. My approach will be: • Connect securely to the specified database using Python (mysql-connector / SQLAlchemy as required) • Analyze completed query logs to determine object usage over the defined time range • Compare tables and views against execution history • Generate a clean CSV output with exactly the required columns • Ensure performance efficiency and clear, well-documented code The script will be modular, easy to configure, and compatible with your existing environment. I can also include brief usage documentation to help you run it independently. I am available to start immediately and can deliver within a short timeframe after reviewing your database structure and log format. Looking forward to discussing the details. Best regards, Prem Kumar
₹750 INR 48 päivässä
0,0
0,0

This is clean Python systems work and I can knock it out fast. Program 1 (Athena): I work with boto3 and Athena daily on AWS. I will query completed executions via the Athena API, parse SQL to trace direct and indirect references through CTEs and view chains, and output the exact CSV schema you specified. Dependency walking is the interesting part here and I will handle nested views properly. Program 2 (SQL Server): Query Store makes this straightforward. I will use pyodbc to pull execution history, scan all object types (tables, views, procs, triggers, queues, functions), and produce the matching CSV with RemovalSql only for confirmed unused objects. Both scripts will accept CLI args for connection info, lookback period, and output path. Clean, well-commented code with logging. I am a Python backend engineer and co-founder of CloudNSite. Former DevOps at Booz Allen Hamilton with extensive AWS and database experience. This type of infrastructure tooling is work I enjoy and do well. Can deliver both scripts with README and sample CSVs within 3-4 days.
₹1 000 INR 5 päivässä
0,0
0,0

Hello! For Need #1 you need to Enable CloudTrail and also install boto3 and awswrangler libraries to enable a python script to run and collect the info you need. And please be aware that query logs are only available for 45 days, so we´ll not be able to search periods greater than that. For Need #2 we don´t have this limitation, we can access all executed queries since last SQL Server restart. To finish both scripts and guarantee a high quality and reliable output, I need from 50 to 60 hours. I´m happy to talk right now and start this ASAP. Regards, Gabriela
₹1 200 INR 25 päivässä
0,0
0,0

Kanniyakumari, India
Liittynyt helmik. 17, 2025
$10-30 USD
€8-30 EUR
₹750-1250 INR/ tunnissa
₹600-1500 INR
$30-250 CAD
$25-50 USD/ tunnissa
$10-30 USD
$115-200 HKD/ tunnissa
$30-250 USD
£3000-5000 GBP
₹600-1500 INR
₹750-1250 INR/ tunnissa
min ₹2500 INR/ tunnissa
£20-250 GBP
₹750-1250 INR/ tunnissa
$30-250 USD
£250-750 GBP
€200-500 EUR
$2-8 USD/ tunnissa
$30-250 USD