Improve table creation time (SQL)


The aim of the project is to transform the rawdata tables to reldata tables.

The transformation algorithm goes as follows,

1) Find the rank of each output field for each records when considering the same output field across all records that share the same date

2) Divide this rank for each record by the total records for the particular date to find its percentile position in the set

This algorithm is also visually described in the attached "Calculation Description.xlsx"

The project (attached) is currently written in [url removed, login to view] and connected to a SQL Server 2012 database, and the transformation was conducted using a single SQL statements. All the transformations algorithm are the same, as you will see the Rel_Calc() method, it is a basic loop to execute the same sql statement multiple times.


Use any method _other than multithreading_ to help improve performance.

This includes=

- Change of database type (from sqls to sqlite, etc)

- Change of database configuration

- Changing the SQL query used

- Using methods other than the SQL query currently used to generate the output

Our current performance is in the attached "performance.jpg", approx 1 min per table. Note the software is being run on an i7 laptop in 32-bit windows 7.


1. [url removed, login to view] â?? the current project written in [url removed, login to view]

2. [url removed, login to view] â?? the zipped sql server 2012 db and log file, login details can be find in the [url removed, login to view] connection string

3. Calculation [url removed, login to view] â?? demonstration of the transformation work


33%-66% reduction in average time per table -> $50

66%-90% reduction in average time per table -> $75

90%+ reduction in average time per table -> $100

Please also note I will have more projects of this type coming up -- keen to use this project to develop an ongoing relationship for many more jobs.

Kind regards

Taidot: .NET, Big Data, tietojenkäsittely, SQL

Näytä lisää: vb creation, vb algorithm, jobs login, total jobs login, string processing algorithm, string algorithm, set algorithm, objective statement, net algorithm, loop net, jobs objective, develop algorithm, changing jobs, algorithm string, algorithm set, algorithm jobs, algorithm creation, performance jobs, log time, database creation software, xlsx, time table, time record, table, table creation

About the Employer:
( 19 reviews ) Melbourne, Australia

Projektin tunnus: #1715153

17 freelanceria on tarjonnut keskimäärin 176 $ tähän työhön


hello Sir, please checkout my PM

250 $ USD 5 päivässä
(110 arvostelua)

I can deliver the changes

250 $ USD 8 päivässä
(80 arvostelua)

Hi, We have excellent eCommerce .Net,and PHP expertise. Please have a look at private message for relevant work done. Awaiting a positive response from your end and looking forward to work with you. Thanks

250 $ USD 30 päivässä
(39 arvostelua)

Hi, 8+ years experience in the [url removed, login to view] ( C# ) , Java script ,Ajax and Mssql field.i am Microsoft Certified Solution Developer. I have team develop software and website .. The Administrator removed this message fo Lisää

150 $ USD 5 päivässä
(4 arvostelua)

Hi, I read at your project demands. I also have downloaded database and VS solution. I have implemented simple indexing on RAW tables and achieve up to 50% of improvement of REL tables creation time. Performance detail Lisää

200 $ USD 1 päivässä
(6 arvostelua)

Hello, I have looked in to your files. We can fix your issues. Thanks Khalid

250 $ USD 3 päivässä
(1 arvostelu)

Hello Sirs, I have more than 10 years experience in programming. So, I could deliver best possible result. Regards

100 $ USD 7 päivässä
(0 arvostelua)

Hi , Wrking as SQL [url removed, login to view] Complete the wrk in time with proper results. Thanks

100 $ USD 7 päivässä
(0 arvostelua)

Hello, I am havin nearly 7 years of IT experience. Working on dataware house project for UK based insurance company. Based on my experience on finance domain and dataware house, I will be able to execute above requi Lisää

200 $ USD 15 päivässä
(0 arvostelua)

Hello, I am glad to work with you.

300 $ USD 10 päivässä
(0 arvostelua)

We are a software engineering team with development, testing and DBA . So i thimk we are suitable to do your project.

150 $ USD 6 päivässä
(0 arvostelua)

Hi, Thank you for posting your requirement. Can we discuss some points before give you more details.

200 $ USD 3 päivässä
(0 arvostelua)

Hello Sir, We have downloaded the data files and studied your project too. We are very well familiar with such type of work. Check your PMB for further details . Thanks - Samir

100 $ USD 4 päivässä
(0 arvostelua)

I already worked on similar project......

50 $ USD 3 päivässä
(0 arvostelua)

Hello, I have couple of guys who would be perfect fit with significant experience in development of financial software and MySQL. Some examples of our work: [url removed, login to view] We would be glad to help you Lisää

250 $ USD 1 päivässä
(0 arvostelua)

11+ Years of experience in performance optimization using MS technologies.

150 $ USD 4 päivässä
(0 arvostelua)

hi sir, I believe I can definitely help you out here. Please check my PM.

50 $ USD 1 päivässä
(0 arvostelua)