I am new to ssis and i am a little bit confused about the SCD_Start_Date and SCD_End_Date when we use the SCD dimension wizard. on many examples that i have searched online people always use the "system start time" or "system container " start time. but i am implementing a data warehouse from a scratch but our company have multiple data sources from two or three years ago. so when i upload our data source from these two years into our dw after running the package it will obviously show that, for example, a seller (seller Dimension) changed from department in the day i ran that package but this is wrong because i want to have a reference date that is in the data source (each row has a data_Ref) . isn't this the logic or am i missing something? how do you guys in BI upload old data source with a reference date?
SCD Start and End Date
689 Views Asked by rafamaniac At
1
There are 1 best solutions below
Related Questions in SSIS
- Data streams in case of Merge
- SSIS Package Component Intermittently Failing
- How to run an SSIS package having excel source on a server where excel is not installed using SQL Server Agent Job
- SSIS exit code error with batch file
- excel datasource returning nulls with sql command
- String to DATETIME with TimeZone
- Error executing SSIS Package
- SSIS Stops at a Particular Record Count
- How to know expected completion time of SQL Server SSIS job?
- Accessing parent parameters from child package SSIS 2012
- Is there a way to export huge amount of data (more than a million rows) from SQL Server to csv?
- ssis - No value given for one or more required parameters
- Split CSV file based on first column value changes and load into destination table in SSIS?
- Automated file import with SSIS package
- SSIS ETL parallel extraction from a AS400 file
Related Questions in DATA-WAREHOUSE
- Big data with spatial queries/indexing
- Joining date and time field in Tableau
- Talend Open Studio for Big Data
- spark stream and spark sql with data warehouse
- Errors in the OLAP storage engine: The attribute key cannot be found when processing
- Anchor modeling - tie: make first role?
- Is star schema still necessary for a big-data-warehouse?
- How to batch export raw data from Omniture (SiteCatalyst or Adobe Analytics)
- Omniture Data Warehouse Segments Issue
- Plotting data cubes
- SQL Server Storing DateTime as Integer
- When we use Datamart and Datawarehousing?
- How to merge two or more queries with different where conditions? I have to reuse the code which is being used in 1st where code
- Structural difference between Relational Databases vs. Multidimensional Databases
- Shell Script to Validate Filename
Related Questions in BUSINESS-INTELLIGENCE
- MDX union members in different hierarchies
- SSRS Subscription Failure
- pentaho can't access by chrome
- QlikView Resources
- Error handler for sum in ssrs
- Statistical average as the number of items averaged increases, regardless of their value
- Structural difference between Relational Databases vs. Multidimensional Databases
- How to assign a same number of business day as Monday to weekend days
- SSRS Containing Group Labels
- What is the difference between a Technical key and a Surrogate key?
- What techniques are used to handle different timezone during OLAP calculation?
- ETL Script to dynamically map multiple EXECUTE SQL resultset to multiple tables (table name based on sql file provided)
- How to conditional count in MicroStrategy?
- Many to Many Unit Conversion SSAS Multi-Dimensional
- How to avoid scentific notation in Saiku Attribute
Related Questions in SCD
- JAXB generated classes of certain types implementing a custom interface
- Slowly Changing Dimension Transform in SSIS won't update
- SQL Server SCD II implementation quandary
- How to map varchar(max) column in SCD transform while doing ETL process in SSIS project?
- Slowly changing dimension by date only
- Implementing SCD2 in Azure Data Factory: Duplicate Issue on Row Update
- Capture Bigquery data changes
- Create table with effective_from_date and effective_to_date from history table in BigQuery
- Implement SCD Type 2 on periodic snapshot table
- How to pivot down the results of a SCD type 2?
- Slow changing dimension | SCD type 1 deleting rows from prior date data
- Slowly changing dimension type 2 implementation in SSIS
- How can I specify the start and end dates for SSIS SCD type 2 wizard instead of variables
- How to turn SCD type 4 into type 6
- SCD Start and End Date
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?

SCD Start and End dates are the dates that a version of the record became (or stopped being) the current version in your source system - they have nothing to do with when data was moved between environments (unless that movement was part of a transaction that changed the state of a record).
Going forward, it is relatively easy to create new SCD records and you insert a new version of a record (and update the previous current version of the record) every time there is a change in the source system.
Loading historic data is entirely dependent on your source system. If it only holds the current version of a record then you can only load that single version into your DWH. If the source system, contains a history of the changes made (or, for example, an audit trail of changes made) then you should be able to re-construct the history in a way that allows you to load multiple versions of a record into your DWH