Peruttu

Improve table creation time (SQL)

Background

The aim of the project is to transform the rawdata tables to reldata tables.

The transformation algorithm goes as follows,

1) Find the rank of each output field for each records when considering the same output field across all records that share the same date

2) Divide this rank for each record by the total records for the particular date to find its percentile position in the set

This algorithm is also visually described in the attached "Calculation Description.xlsx"

The project (attached) is currently written in vb.net and connected to a SQL Server 2012 database, and the transformation was conducted using a single SQL statements. All the transformations algorithm are the same, as you will see the Rel_Calc() method, it is a basic loop to execute the same sql statement multiple times.

Objective

Use any method _other than multithreading_ to help improve performance.

This includes=

- Change of database type (from sqls to sqlite, etc)

- Change of database configuration

- Changing the SQL query used

- Using methods other than the SQL query currently used to generate the output

Our current performance is in the attached "performance.jpg", approx 1 min per table. Note the software is being run on an i7 laptop in 32-bit windows 7.

Attachment:

1. [url removed, login to view] â?? the current project written in vb.net

2. [url removed, login to view] â?? the zipped sql server 2012 db and log file, login details can be find in the vb.net connection string

3. Calculation [url removed, login to view] â?? demonstration of the transformation work

Reward

33%-66% reduction in average time per table -> $50

66%-90% reduction in average time per table -> $75

90%+ reduction in average time per table -> $100

Please also note I will have more projects of this type coming up -- keen to use this project to develop an ongoing relationship for many more jobs.

Kind regards

----- UPDATE --------

Don't know if the files I uploaded to Freelancer are available. If not I have uploaded them to mediafire.

[database - 100mb]
http://www.mediafire.com/?vwf2wbz29wyw2m2

[project - 66kb]
http://www.mediafire.com/?3mw9isja23w2mqx

[spreadsheet - 20kb]
http://www.mediafire.com/?q3dcp8xv8bxiipz

------ UPDATE 2 ---------

Performance document now attached to this project
(This shows current performance on my PC, the project success will be measured against this number)

To clarify, on the goals of project success -

Milestone payment at 25% improvement
Project success at 50% improvement
Bonus payments at 75% improvement and 90% improvement
(bonus amounts negotiated via PM)

------ UPDATE 2 ---------

Performance screencap now uploaded - http://imgur.com/TXsSf

(This shows current performance on my PC, the project success will be measured against this number)

To clarify, on the goals of project success -

Milestone payment at 25% improvement
Project success at 50% improvement
Bonus payments at 75% improvement and 90% improvement
(bonus amounts negotiated via PM)

Taidot: .NET, Big Data, tietojenkäsittely, SQL

Näytä lisää: vb .net jobs, vb net algorithm, vb creation, vb algorithm, up jobs login, total jobs login, string processing in c, string processing algorithm, string algorithm, set algorithm, objective statement, objective c jobs, net algorithm, loop net, jobs vb net, jobs objective c, jobs in vb.net, develop an algorithm, develop algorithm, changing jobs, algorithm vb.net, algorithm string, algorithm set, algorithm jobs, algorithm creation

Tietoa työnantajasta:
( 24 arvostelua ) Melbourne, Australia

Projektin tunnus: #1715153

17 freelancers are bidding on average $176 for this job

OShuqair

hello Sir, please checkout my PM

250 $ USD 5 päivässä
(110 arvostelua)
8.2
srinichal

I can deliver the changes

250 $ USD 8 päivässä
(80 arvostelua)
6.8
sandeep25101982

Hi, We have excellent eCommerce .Net,and PHP expertise. Please have a look at private message for relevant work done. Awaiting a positive response from your end and looking forward to work with you. Thanks

250 $ USD 30 päivässä
(39 arvostelua)
6.6
zeromaxsolution

Hi, 8+ years experience in the Asp.net ( C# ) , Java script ,Ajax and Mssql field.i am Microsoft Certified Solution Developer. I have team develop software and website .. The Administrator removed this message fo Lisää

150 $ USD 5 päivässä
(4 arvostelua)
3.3
Dusan74

Hi, I read at your project demands. I also have downloaded database and VS solution. I have implemented simple indexing on RAW tables and achieve up to 50% of improvement of REL tables creation time. Performance detail Lisää

200 $ USD 1 päivässä
(6 arvostelua)
3.3
assuranceES

Hello, I have looked in to your files. We can fix your issues. Thanks Khalid

250 $ USD 3 päivässä
(1 arvostelu)
2.8
theidasworld

Hello Sirs, I have more than 10 years experience in programming. So, I could deliver best possible result. Regards

100 $ USD 7 päivässä
(0 arvostelua)
0.0
SrideviBoddu

Hi , Wrking as SQL [url removed, login to view] Complete the wrk in time with proper results. Thanks

100 $ USD 7 päivässä
(0 arvostelua)
0.0
Dhara3011

Hello, I am havin nearly 7 years of IT experience. Working on dataware house project for UK based insurance company. Based on my experience on finance domain and dataware house, I will be able to execute above requi Lisää

200 $ USD 15 päivässä
(0 arvostelua)
0.0
ihassa

Hello, I am glad to work with you.

300 $ USD 10 päivässä
(0 arvostelua)
0.0
futurefocus23

We are a software engineering team with development, testing and DBA . So i thimk we are suitable to do your project.

150 $ USD 6 päivässä
(0 arvostelua)
0.0
saurabhregime

Hi, Thank you for posting your requirement. Can we discuss some points before give you more details.

200 $ USD 3 päivässä
(0 arvostelua)
0.0
JGSolutions

Hello Sir, We have downloaded the data files and studied your project too. We are very well familiar with such type of work. Check your PMB for further details . Thanks - Samir

100 $ USD 4 päivässä
(0 arvostelua)
0.0
Praveen225627

I already worked on similar project......

50 $ USD 3 päivässä
(0 arvostelua)
0.0
ETNASoftware

Hello, I have couple of guys who would be perfect fit with significant experience in development of financial software and MySQL. Some examples of our work: [url removed, login to view] We would be glad to help you Lisää

250 $ USD 1 päivässä
(0 arvostelua)
0.0
syedsabaur

11+ Years of experience in performance optimization using MS technologies.

150 $ USD 4 päivässä
(0 arvostelua)
0.0
q1p

hi sir, I believe I can definitely help you out here. Please check my PM.

50 $ USD 1 päivässä
(0 arvostelua)
0.0