I subscribe to a data service (IQFeed) that provides live intra-day data. See attached API guide / [url removed, login to view]
I need to have three databases built that maintain price data locally for 2000+ stocks on a continuous basis and would like to have a function built enabling MS Excel to read data from the databases very quickly.
Data should be initially collected in three databases from IQFeed reflecting three different time frames â€“ 5 minute data, hourly data, and daily data. If just one database were built, too much intra-day data would need to be stored to capture 2500 periods of end of day data.
The database needs to run in the background collecting current data from IQFeed - it should not require intensive processing capacity as other applications will be running concurrently.
The only data that needs to be collected is closing price â€“ a single data-point for every period for every stock.
Data in the database needs to be vetted to ensure that there are no missing periods. Comparability of data across securities is essential. If a data point is missing, the previous data point should be used. If a CSV file is subsequently updated, including previously missing or errant data, the database should be updated to include this corrected data.
Data is time stamped at the end of the period (ie the last price between 9:30 and 9:35am is stamped 9:35am)
Some securities have 24 hours of data per day (currencies â€“ 7pm Sunday through 4pm Friday) while others (stocks) will just have data between 9:30 and 4pm. In the future, foreign securities will be added that have yet different trading periods due to time zone differences.
The following information will be provided in an excel spreadsheet ([url removed, login to view]) which should be used to determine which securities are to be maintained/updated.
â€¢ Security Name
â€¢ Security Type
â€¢ Security Industry
â€¢ Stock Sector
â€¢ Times for which data is collected (ie 9:30 to 4:00, 24hrs)
Any additions/deletions/changes would be reflected in [url removed, login to view]
Initially three databases need to be built to hold Minute, Hourly, and Daily data â€“ 2500 periods of data are needed in each. The data for all three databases will come from the same CSV files. Data from the hourly and daily files can come from the minute database or from the CSV files
Data in the current databases can be limited to 2500 periods, however historic data should be saved in some manner. The amount of data stored in the current database should be flexible (>2500).
Current vs. Future/Incremental timeframes - initially 5 minute data will be used, however this may change to 1 data in the future. Hourly and daily are likely to always remain.
Databases should be updated every five minutes
The daily and hourly databases should use the most recent minute datapoint as the last â€œhourâ€ or â€œdayâ€ (ie until 2:50pm, use the 2:45pm data point as the end of the day point until 3pm for the hourly database and until 4pm for the daily database).
Additions/Deletions/Changes will need to be made reflecting the fact that certain stocks will be added over time and others deleted as per the [url removed, login to view] file
The databases should assume 5 business days per week; however, a manual override should be used to allow for holidays when data would not be captured.
The databases need to be transferred easily to other computers such that other computers can read the data locally.
Import into Excel
Build a function that pulls in at least 500 data-points from any of the databases using the following inputs (the import function should look to cells in a spreadsheet to get this information):
â€¢ Stock ticker
â€¢ Periodicity (5 minute, 10 minute, hour, 2 hour, day, 3 day)
â€¢ Starting point (most recent period or historic)
â€¢ Number of periods
â€¢ Daily period (9:30 â€“ 4pm or 24hrs)
See â€œ[url removed, login to view]â€ for a basic file showing inputs/output. Note that date/time data is optional, and that multiple time frames could be drawn from one database.
Already constructed Excel macros will be used to pull in data for multiple stocks and multiple timeframes at once in rapid succession. Hence, any functions built to pull in the data from the databases must be callable by a macro.
Stock name and historic data is only output required (time data is not required if it slows the function down).
Data should always be sorted from most recent at the top to older at the bottom.
18 freelancers are bidding on average $543 for this job
I am intrested to do this project iam confident about the success of this project because i have sound knowledge about databases i hope u will sure accept my service
Dear Sir, I am currently working Futures Industry risk management. Have knowleadge of trades reconcillation. Besides dealing with Futures Products, I deal with Forex and Options. I understand what you are looking for.