wileylogo.gif (1662 bytes)
WILEY WelcomeBook InfoTools and UtilitiesInternet LinksAuthorsAuthorsAuthorsbookcover2.gif (11351 bytes)

Table of Contents

This table of contents is a little more interactive than the one in the book.  We squeezed it all on one page so you can move back and forth among chapters more easily.   It's also makes it easier to print out the whole thing to give you the overall context while you are down in the details of a specific chapter. 

The first section below lists all the chapter titles, with links to each chapter's table of contents.

Chapter Table of Contents

Introduction
Chapter   1 – The Chess Pieces

SECTION  1   PROJECT MANAGEMENT AND REQUIREMENTS

Chapter   2 – Business Dimensional Lifecycle™
Chapter   3 – Project Planning and Management
Chapter   4 – Collecting Business Requirements

SECTION  2    DATA DESIGN
Chapter   5 – A First Course on Dimensional Modeling
Chapter   6 – A Graduate Course on Dimensional Modeling
Chapter   7 – Building the Dimensional Model

SECTION 3   ARCHITECTURE

Chapter   8 – Introducing Data Warehouse Architecture
Chapter   9 – Architecture for the Back Room
Chapter 10 – Architecture for the Front Room
Chapter 11 – Infrastructure and Metadata
Chapter 12 – A Graduate Course on the Internet and Security
Chapter 13 – Creating the Architecture Plan and Selecting Products

SECTION  4    IMPLEMENTATION
Chapter 14A Graduate Course on Aggregates
Chapter 15 – Completing the Physical Design
Chapter 16 – Data Staging
Chapter 17 – Building End User Applications

SECTION  5    DEPLOYMENT AND GROWTH
Chapter 18 – Planning the Deployment
Chapter 19Maintaining and Growing the Data Warehouse

Appendix A    Lifecycle Project Plan
Appendix B   About the CD-ROM

Introduction 1
(Return to top)
Level of Understanding 2
How to Use the Book Actively 3
The Purpose of Each Chapter 5
Section 1: Project Management and Requirements 5
Section 2: Data Design 6
Section 3: Architecture 7
Section 4: Implementation 8
Section 5: Deployment and Growth 9
Supporting Tools 9
The Goals of a Data Warehouse 9
The Goals of this Book 11
Visit the Companion Web Site 12
Chapter 1 The Chess Pieces 13
(Return to top)
Basic Elements of the Data Warehouse 14
Source System 14
Data Staging Area 16
Presentation Server 16
Dimensional Model 17
Business Process 18
Data Mart 18
Data Warehouse 19
Operational Data Store (ODS) 19
OLAP (On-Line Analytic Processing) 21
ROLAP (Relational OLAP) 21
MOLAP (Multidimensional OLAP) 21
End User Application 21
End User Data Access Tool 21
Ad Hoc Query Tool 22
Modeling Applications 22
Metadata 22
Basic Processes of the Data Warehouse 23
The Big Data Warehouse Debates 25
Data Warehouse Modeling 26
Data Marts and Data Warehouses 27
Distributed versus Centralized Data Warehouses 28
Summary 28
SECTION 1 PROJECT MANAGEMENT AND REQUIREMENTS 29
Chapter 2 The Business Dimensional Lifecycle 31
(Return to top)
Lifecycle Evolution 31
Lifecycle Approach 33
Project Planning 33
Business Requirements Definition 34
Data Track: Dimensional Modeling 34
Data Track: Physical Design 35
Data Track: Data Staging Design and Development 35
Technology Track: Technical Architecture Design 35
Technology Track: Product Selection and Installation 36
Application Track: End User Application Specification 36
Application Track: End User Application Development 36
Deployment 36
Maintenance and Growth 37
Project Management 37
Guidelines for Using the Business Dimensional Lifecycle 38
Business Dimensional Lifecycle Mile Markers and Navigation Aids 39
Summary 40
Chapter 3 Project Planning and Management 41
(Return to top)
Define the Project 42
Assess Your Readiness for a Data Warehouse 43
Take the Readiness "Litmus Test" 46
Evaluate your Combined Readiness Factors 46
Techniques to Address Readiness Shortfall 49
Develop the Preliminary Scope 53
Build the Business Justification 58
Plan the Project 64
Establish the Project Identity 64
Staff the Project 64
Develop the Project Plan 73
Manage the Project 77
Conduct the Project Team Kickoff Meeting 78
Monitor Project Status 79
Maintain the Project Plan and Project Documentation 82
Manage the Scope 83
Develop Communications Plan to Manage Expectations 86
Summary 91
Chapter 4 Collecting the Requirements 95
(Return to top)
Overall Approach to Requirements Definition 96
Interviews versus Facilitated Sessions 97
Prepare for the Interview 98
Identify the Interview Team 98
Conduct the Pre-interview Research 101
Select the Interviewees 102
Develop the Interview Questionnaires 104
Schedule the Interviews 104
Prepare the Interviewees 108
Conduct the Interview 111
Remember your Interview Role 111
Verify Communications 112
Define Terminology 112
Establish Peer Basis 113
Maintain Interview Schedule Flexibility 113
Avoid Interview Burnout 113
Manage Expectations Continuously 114
Start the Interview 114
Business Executive Interview Content 116
Business Manager or Analyst Interview Content 117
IS Data Audit Interview Content 120
Wrap Up the Interview 122
Determine the Success Criteria 122
Review the Interview Results 126
Prepare and Publish the Requirements Deliverables 128
Agree on Next Steps After Collecting Requirements 131
Facilitation for Confirmation, Prioritization, and Consensus 132
Facilitation as an Alternative to Interviewing 132
Summary 133
SECTION 2 DATA DESIGN 137
Chapter 5 A First Course on Dimensional Modeling 139
(Return to top)
The Case for Dimensional Modeling 140
What is Entity-Relationship Modeling? 140
What is Dimensional Modeling? 144
The Relationship between Dimensional Modeling and Entity-Relationship Modeling 146
The Strengths of Dimensional Modeling 147
Putting Dimensional Models Together: The Data Warehouse Bus Architecture 153
The Planning Crisis 153
Data Marts with a Bus Architecture 155
Conformed Dimensions and Standard Fact Definitions 156
Designing the Conformed Dimensions 158
Taking the Pledge 158
Establishing the Conformed Fact Definitions 159
The Importance of Data Mart Granularity 160
Multiple-Source Data Marts 161
Rescuing Stovepipes 162
When You Don’t Need Conformed Dimensions 163
The Data Warehouse Bus 164
Basic Dimensional Modeling Techniques 164
Fact Tables and Dimension Tables 165
Inside Dimension Tables, Drilling Up and Down 167
Foreign Keys, Primary Keys, and Surrogate Keys 191
Additive, Semiadditive, and Nonadditive Facts 193
The Four-Step Design Method for Designing an Individual Fact Table 194
Families of Fact Tables 200
Factless Fact Tables 212
Summary 216
Chapter 6 A Graduate Course on Dimensional Modeling 217
(Return to top)
Extended Dimension Table Designs 218
Many-to-Many Dimensions 218
Many-to-One-to-Many Traps 222
Role-Playing Dimensions 223
Organization and Parts Hierarchies 226
Unpredictably Deep Hierarchies 231
Time Stamping the Changes in a Large Dimension 233
Building an Audit Dimension 237
Too Few Dimensions and Too Many Dimensions 238
Extended Fact Table Designs 240
Facts of Differing Granularity and Allocating 240
Time of Day 245
Multiple Units of Measure 247
Multinational Currency Tracking 248
Value Band Reporting 251
Advanced ROLAP Querying and Reporting 252
Drill-Across Queries with Multiple Technologies 252
Self Referencing Queries, Behavior Tracking, and Sequential Subsetting 254
Market Basket Analysis 260
Summary 263
Chapter 7 Building Dimensional Models 265
(Return to top)
Matrix Method for Getting Started 266
Build the Matrix 266
Use the Four-Step Method to Design Each Fact Table 272
Managing the Dimensional Modeling Project 276
Data Warehouse Bus Architecture Matrix 277
Fact Table Diagram 277
Fact Table Detail 280
Dimension Table Detail 281
Steps for the Dimensional Modeling Team 285
Managing Issues in the Modeling Process 294
Identifying the Sources for Each Fact Table and Dimension Table 296
When Are You Done? 307
Using a Data Modeling Tool 309
Summary 312
SECTION 3 ARCHITECTURE 315
Chapter 8 Introducing Data Warehouse Architecture 317
(Return to top)
The Value of Architecture 318
An Architectural Framework and Approach 320
Defining the Columns 322
Defining the Levels of Detail (the Rows) 324
Logical Models and Physical Models 326
Framework Summary 327
Technical Architecture Overview 327
Services and Data Stores 330
Flow from Source System to User Desktop 330
Key Technical Architecture Features 331
Evolution of Your Data Warehouse Architecture 333
Summary 334
Chapter 9 Back Room Technical Architecture 335
(Return to top)
Back Room Data Stores 336
Source Systems 336
Data Staging Area 344
The Presentation Servers 346
Back Room Services 350
General Data Staging Requirements 351
Build versus Buy 356
Extract Services 357
Data Transformation Services 360
Data Loading Services 363
Data Staging Job Control Services 364
Back Room Asset Management 367
Backup and Recovery 367
Archive and Retrieval 368
Backup and Archive Planning 369
Extract and Load Security Issues 369
Future Staging Services 370
Summary 372
Chapter 10 Architecture for the Front Room 373
(Return to top)
Front Room Data Stores 375
Access Tool Data Stores 375
Standard Reporting Data Stores 375
Downstream Systems 378
Front Room Services for Data Access 378
Warehouse Browsing 379
Access and Security Services 380
Activity Monitoring Services 380
Query Management Services 381
Query Service Locations 385
Standard Reporting Services 386
Future Access Services 388
Desktop Services 389
Modeling Applications and Data Mining 400
Web Implications for Data Access 404
Desktop Tool Architecture Approaches 406
Summary 409
Chapter 11 Infrastructure and Metadata 411
(Return to top)
Infrastructure 412
Drivers of Infrastructure 412
The Evolution of Infrastructure 413
Back Room Infrastructure Factors 413
Front Room Infrastructure Factors 429
Connectivity and Networking Factors 432
Infrastructure Summary 434
Metadata and the Metadata Catalog 435
Metadata: What Is It? 435
Source System Metadata 436
Data Staging Metadata 437
DBMS Metadata 438
Front Room Metadata 438
An Active Metadata Example 439
Metadata Catalog Maintenance 445
Metadata Summary 447
Summary 447
Chapter 12 A Graduate Course on the Internet and Security 449
(Return to top)
Component Software Architecture 452
The Impact of the Internet on Architecture 454
Security: Vulnerabilities 457
Physical Assets 459
Information Assets: Data, Financial Assets, and Reputation 459
Software Assets 467
The Ability to Conduct Your Business 467
Network Threats 467
Security: Solutions 472
Routers and Firewalls 474
The Directory Server 479
Encryption 481
Managing Security in a Data Warehouse Environment 495
What to do Now About Security 497
Immediate Tactical Measures 497
Strategic Measures 498
Summary 499
Chapter 13 Creating the Architecture Plan and Selecting Products 501
(Return to top)
Creating the Architecture 502
Architecture Development Process 503
Selecting the Products 514
Keeping a Business Focus 514
Major Warehouse Evaluation Areas 515
Evaluation Process 516
Evaluations for the Back Room 530
Evaluations for the Front Room 532
Installation 535
Summary 536
SECTION 4 IMPLEMENTATION 541
Chapter 14 A Graduate Course on Aggregates 543
(Return to top)
Aggregation Goals and Risks 544
Deciding What to Aggregate 545
Develop the Aggregate Table Plan 547
Processing Aggregates 549
Administering the Aggregates 552
Design Goals for an Aggregate Navigation System 555
Design Goal 1 556
Design Goal 2 557
Design Goal 3 559
Design Goal 4 560
Aggregate Navigation Algorithm 560
Intersecting Planning Data 564
Handling MIN, MAX, COUNT, and AVG 565
Aggregates for Everyone 566
Summary 567
Chapter 15 Completing the Physical Design 569
(Return to top)
Develop Standards 571
Database Object Naming Standards 571
Use Synonyms for All Tables That Users Access 574
Physical File Locations 574
Develop the Physical Data Model 575
The Beverage Store Sales Case Study 577
Use a Data Modeling Tool 578
Design the Physical Data Structure 578
Develop Initial Sizing Estimates 583
Develop the Initial Index Plan 585
Overview of Indexes and Query Strategies 587
Indexing Fact Tables 590
Indexing Dimension Tables 591
Indexing for Loads 592
Analyze Tables and Indexes after the Load 592
Case Study Indexes 592
Design and Build the Database Instance 592
Memory 595
Blocksize 595
Disk Access Example 595
Save the Database Build Scripts and Parameter Files 597
Develop the Physical Storage Structure 598
Compute Table and Index Sizes 598
Develop the Partitioning Plan 598
Set up RAID 599
Implement Usage Monitoring 601
Performance 602
User Support 602
Marketing 603
Planning 603
Tools 604
Summary 605
Chapter 16 Data Staging 609
(Return to top)
Data Staging Overview 610
Do the Preliminary Work 611
Importance of Good System Development Practices 611
Plan Effectively 611
Step 1. High-Level Plan 612
Step 2. Data Staging Tools 612
Step 3. Detailed Plan 615
Dimension Table Staging 617
Step 4. Populate a Simple Dimension Table 617
Step 5. Implement Dimension Change Logic 625
Step 6. Populate Remaining Dimensions 629
Fact Table Loads and Warehouse Operations 630
Step 7. Historical Load of Atomic-Level Facts 631
Step 8. Incremental Fact Table Staging 641
Step 9. Aggregate Table and MOLAP Loads 647
Step 10. Warehouse Operation and Automation 650
Data Quality and Cleansing 653
Data Improvement 654
Data Quality Assurance 658
Miscellaneous Issues 659
Archiving in the Data Staging Area 659
Source System Rollback Segments 659
Disk Space Management 660
Summary 661
Chapter 17 Building End User Applications 665
(Return to top)
Role of the End User Application 666
What Is an End User Application Template? 667
Lifecycle Timing 669
Application Specification 670
Determine the Initial Template Set 670
Design the Template Navigation Approach 674
Determine Template Standards 675
Detailed Template Specification 677
User Review 677
End User Application Development 678
Select an Implementation Approach 680
Application Development 681
Testing and Data Verification 683
Document and Roll Out 684
Think Like a Software Development Manager 684
Application Template Maintenance 685
Summary 686
SECTION 5 DEPLOYMENT AND GROWTH 689
Chapter 18 Planning the Deployment 691
(Return to top)
Determine Desktop Installation Readiness 692
Develop the End User Education Strategy 693
Integrate and Tailor Education Content 693
Develop the End User Education 696
Deliver the End User Education 697
Develop an End User Support Strategy 699
Determine the Support Organization Structure 700
Anticipate Data Reconciliation Support 701
Anticipate End User Application Support 702
Establish Support Communication and Feedback 702
Provide Support Documentation 703
Develop the Deployment Release Framework 705
Alpha Release 706
Beta Release 706
Production Release (a.k.a. Deployment) 708
Document Your Deployment Strategy 710
Summary 711
Chapter 19 Maintaining and Growing the Data Warehouse 715
(Return to top)
Manage the Existing Data Warehouse Environment 716
Focus on Business Users 718
Manage Data Warehouse Operations 720
Measure and Market Your Data Warehouse Success 723
Communicate Constantly 726
Prepare for Data Warehouse Growth and Evolution 727
Establish a Data Warehouse Steering Committee 728
Prioritize Growth and Evolution Opportunities 729
Manage Iterative Growth and Evolution Using the Lifecycle 731
Summary 733
Appendix A Lifecycle Project Plan 737
(Return to top)
Appendix B About the CD-ROM 747
Project Plan 747
Data Warehouse Bus Architecture Example 748
Templates, Checklists, Figures, and Aids 749
Chapter 2: Business Dimensional Lifecycle 750
Chapter 3: Project Planning and Management 750
Chapter 4: Collecting the Requirements 750
Chapter 7: Building Dimensional Models 751
Chapter 8: Introducing Data Warehouse Architecture 751
Chapter 9: Back Room Technical Architecture 751
Chapter 10: Architecture for the Front Room 751
Chapter 11: Infrastructure and Metadata 752
Chapter 12: A Graduate Course on the Internet and Security 752
Chapter 13: Creating the Architecture Plan and Selecting Products 752
Chapter 15: Completing the Physical Design 752
Chapter 16: Data Staging 753
Chapter 17: Building End User Applications 753
Chapter 18: Planning the Deployment 753
Using the CD-ROM 753
CD-ROM Browser Instructions 754
Software Requirements 754
Index 755
(Return to top)

 

The Business Dimensional Lifecycle is a trademark of Ralph Kimball Associates, Inc., DecisionWorks 
Consulting, Inc., StarSoft Solutions, Inc., and InfoDynamics LLC.    All other products mentioned are
registered trademarks or trademarks of their respective companies.

Questions or problems regarding this Web site should be directed to the WebMaster.
Copyright © 1998 Ralph Kimball Associates, Inc., DecisionWorks Consulting, Inc., StarSoft
Solutions, Inc.,  InfoDynamics LLC.   All rights reserved.
Last Updated: 08/03/98