I have an OLTP server and I have another server that serves as the Warehouse. There are a total of around 100 tables and I am inserting/updating the data in the warehouse based on the primary key and Modified-date using an SSIS package and linked server connection. The complete sync process takes around 20-25 minutes and hence the automated job is scheduled to run every 30 minutes. But due to this, I am having a lag of 30 minutes in my warehouse. Do we have any other way out to sync the data between OLTP and warehouse that can reduce the time lag. I don't want to use triggers as it will have impact on the performance of the transactional database.
Migration of data from OLTP to OLAP
951 Views Asked by whywake At
0
There are 0 best solutions below
Related Questions in SQL
- Can MVC.NET prevent SQL-injection at razor or controller level?
- SQL server not returning all rows
- When dealing with databases, does adding a different table when we can use a simple hash a good thing?
- Creating a parametrized field name for a SELECT clause
- Combine two rows based on common ID
- Column displays each count
- Slick query for one to optional one (zero or one) relationship
- Aggregate and count in PostgreSQL
- MAX and GROUP BY - SQL
- SQL statement for a tricky 2 table query
- How to create nested selects with sql?
- Pull and push data from and into sql databases using Excel VBA without pasting the data in Excel sheets
- Best Practice for adding columns to a Table in Oracle database
- SQL FIFO STACK using two tables
- SQL Query - Order by String (which contains number and chars)
Related Questions in SQL-SERVER
- SQL server not returning all rows
- Big data with spatial queries/indexing
- Conditional null constraint on Null
- SQL Query - Order by String (which contains number and chars)
- Optimising a slow running SQL Server Stored procedure ordered by calculated fields to return a closest match
- Dynamics CRM Publishing Customizations - Multi Developers
- Is there anyway to set the relationship of many tables from Model?
- Implementation of Rank and Dense Rank in MySQL
- ORM Code First versa Database First in Production
- MVC : Insert data to two tables
- Data streams in case of Merge
- table with multiple IDs but seperate notes need sorting (Tried SQL code to make a union query)
- SQL table Partitioning by Year with ColumnStore index implemented on the table
- Defining which network to use for SQL Server 2012 Management Studio
- Fill a week days in a table with preceding Sundays value
Related Questions in SQL-SERVER-2008
- How to create separate rows for each unique value in source data
- How to Multiply all values within a column with SQL like SUM()
- Concatenated string in column alias
- Column value divided by row count in SQL Server
- MSSQL Bulk Insert CSV - Multiple columns include commas
- String to DATETIME with TimeZone
- Compare each records of same table in sql server and return duplicates
- 2008R2 SQL Code for case when using the SUM?
- Separate string into columns
- Pass parameters to sql agent job step (Transact-SQL Script)
- using Case get values from different table in sql server
- How to use Replace an unknown length of characters in SQL Server?
- Join Multiple table without using joins
- call an sql function by name returned by select
- How to create a check (Table A.Id and Table B.Id and TypeId = 1)?
Related Questions in SSIS
- Data streams in case of Merge
- SSIS Package Component Intermittently Failing
- How to run an SSIS package having excel source on a server where excel is not installed using SQL Server Agent Job
- SSIS exit code error with batch file
- excel datasource returning nulls with sql command
- String to DATETIME with TimeZone
- Error executing SSIS Package
- SSIS Stops at a Particular Record Count
- How to know expected completion time of SQL Server SSIS job?
- Accessing parent parameters from child package SSIS 2012
- Is there a way to export huge amount of data (more than a million rows) from SQL Server to csv?
- ssis - No value given for one or more required parameters
- Split CSV file based on first column value changes and load into destination table in SSIS?
- Automated file import with SSIS package
- SSIS ETL parallel extraction from a AS400 file
Related Questions in OLTP
- Relational Integrity between OLAP and OLTP
- OLTP-STAGGING-DW-DUPLICATES
- OLAP or ALTP at reporting Tools
- What do Transaction means in OLTP?
- Is a star schema a denormalized schema?
- Concurrent Reads from Highly Transactional Table
- How to compare varchar parameters in a natively compiled stored procedure?
- OLTP type data in a OLAP system
- How to send authenticated traces to tempo cloud using OLTP exporter python?
- What is the "Online" in Online Transaction Processing or Online Analytical Processing
- Using non memory optimised tables in Natively Compiled Stored Procedure without custom table types
- Are there database design types or models that are referred to as numbers
- What is database throughput?
- SSD performance benefit in OLTP vs OLAP
- Using SQL Server 2014 in memory table with arabic collation
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?