Enrolment options
Guests cannot access this course. Please log in.
Course content
Sections:
22
•
Activities:
0
•
Resources:
71
- 1. Welcome to the course
- 2. Course Resources
- 1. Setting up environment and installing PDI
- 2. Opening Spoon - The Graphical UI
- 1. The example problem statement
- 2. Demonstration of a PDI transformation
- 3. Demonstration of a PDI Job
- 1. What is ETL
- 2. Data Warehouse, Ops Database and Data mart
- 3. Inmon vs Kimball Architecture
- 4. ETL vs ELT
- 1. Data and the ETL process
- 1. Manually entering data into PDI
- 2. Inputting Data from a TXT (text) file
- 3. Input from multiple CSV files at the same time
- 4. Inputting Data from an Excel file
- 5. Extracting Data from Zipped files
- 1. Extracting from XML
- 2. Extracting from JSON
- 1. Plan for importing sales Data
- 2. Installing and setting up PostgreSQL
- 3. Creating Sales table in SQL
- 4. Extracting from an SQL table
- 1. Storing Data on AWS S3
- 2. Reading data from AWS S3
- 1. Concepts Merging Data Streams
- 2. Sorted Merge Step - Merging customer data
- 3. Merging product data
- 4. Append data stream - merging sales data
- 1. Introduction to Data Cleansing
- 2. Value Mapper Step
- 3. Replace in String Step
- 4. Fuzzy Match concepts
- 5. Fuzzy Match Step in PDI
- 6. Fuzzy Match Algorithms
- 7. Formula Step and changing data format
- 8. Common Data Cleaning Steps
- 1. Introduction to Data validation
- 2. Data_validation 1 - String-to-Int and integer range validations
- 3. Data validation 2 - Checking Reference Values using stream look-up
- 4. Data validation 3 - Order date shipping date using calculator step
- 5. Common Data Validation steps
- 1. Correcting the errors and merging with main stream
- 2. Writing the errors to the log
- 3. Writing the errors to a separate file
- 1. Concatenating Address Fields
- 2. Data Aggregation using Group-by
- 3. Normalization and Denormalization
- 4. Number Range Step
- 1. Introduction to PDI - SQL connection
- 2. Reading and filtering data from DB into PDI
- 3. Updating and Inserting data into DB from PDI
- 4. Deleting data from SQL DB using PDI
- 1. Facts and Dimensions tables
- 2. Surrogate Keys in Dimension tables
- 3. Type 1 & 2 Slowly Changing Dimensions.
- 4. Schemas
- 1. Creating tables in DB
- 2. Loading Customer Data using combination lookup update step
- 3. Loading product data using dimension lookup step
- 4. Loading sales data after database lookup steps
- 1. Scripting Steps
- 1. PDI Jobs vs Transformation
- 2. Controlling the flow of execution
- 3. Setting variables using set variables step
- 4. File and Folder Management
- 5. Sending Email Step
- 6. Abort Job Step
- 1. Running using command prompt and scheduling
- 1. Metadata injection
- 1. Regular Expressions for advanced String Matching