Report Writers Meeting with Query Performance Tips

undefined
Report Writers Meeting
Query Performance Tips
Gary Yates
12/08/2015
2
Easy Stuff
TIP: Only retrieve the fields you actually need on your
report (Especially if including extra fields from another
dimension)
TIP: Utilize a single list view or crosstab if possible  (Each
one you add—even if you point it at the same query—will
execute the query again)
TIP: Try to keep the calculations in your query as simple
and efficient as possible
3
Partitions
The data in the largest fact tables are divided into
“partitions” by date  (i.e. they are really many tables)
TIP: Always filter on a date attribute for these
Use Fiscal Year Period for most, but Posting Date for
Payroll Charge
Six-month fiscal period partitions:
Financial Accounting Fact
Funds Management Fact
Grants Management Fact
Controlling Fact
Six-month posting date partitions:
Payroll Charge Fact
Fiscal year partitions:
Financial Accounting Fact MV
Funds Management Fact MV
Grants Management Fact MV
Controlling Fact MV
Financial Balances
4
Materialized Views
The four large financial fact tables have materialized
views (MV)
Materialized views pre-aggregate the facts to speed up
access time
They are used transparently if the database can
determine that your query can be re-written to use the
MV
Financial Accounting
Financial Accounting MV
115
27
77% Smaller
Not every field and
dimension is in the
materialized view
Row Count (millions)
5
Materialized Views
Your query doesn’t just have to match the fields in the
view, it also has to match the aggregations used in the
view
All of the views contain a 
total
 on each fact
Examples:
total(amount)
total(expense)
total(revenue)
6
Materialized Views
TIP: Write your query to use only the fields in the materialized
view if possible
TIP: Whenever doing a calculation you need to force the
aggregation before doing the calculation
Example 1:
 
Bad Data Item calculation – Revenue + Expense
Cognos will make this total(Revenue + Expense)
Good Data Item calculation – total(Revenue) + total(Expense)
Example 2:
 
Bad Data Item calculation – Revenue * -1
Cognos will make this total(Revenue * -1)
Good Data Item calculation – total(Revenue) * -1
7
Degenerate Dimensions
There are fields in the fact table that are not facts
Examples:
Facts
Degenerate
Dimensions
8
Degenerate Dimensions
TIP: Don’t filter on a degenerate dimension that is not
indexed (marked with (i) in following slides)
Probably okay if you use some other indexed attribute
AND a non-indexed degenerate dimension
FI MV Dimensions
Additional FI Document Attributes
Asset
Banner Detail Code
Business Area
Commitment Item
Cost Center
Cost Element
Customer
Fiscal Year Period
Functional Area
Fund
Funded Program
Funds Center
GL Account
Grant
Order
Payee/Payer
Vendor
Work Breakdown Structure Element
Document Date
Financial Document Type
Material
Posting Date
Purchase Order
Sponsored Class
Travel Trip
Banner Posting Document (i)
Business Transaction
Changed By
Changed On Date
Check Number (i)
Clearing Document (i)
Clearing Document Line Item
Derived Funds Center
Document Header Text
Document Parked By
FI Accounting Document Number (i)
FI Accounting Line Item Number
Line item Text
Recurring Entry Document Number (i)
Reverse Document Fiscal Year
Reverse Document Number (i)
Degenerate Dimensions
9
FM MV Dimensions
Additional FM Document Attributes
Asset
Banner Detail Code
Business Area
Commitment Item
Customer
Fiscal Year Period
Functional Area
Fund
Funded Program
Funds Center
Grant
Order
Vendor
Work Breakdown Structure Element
Additional FM Budget Document Attributes
FI Document Date
Financial Document Type
Material
Posting Date
Purchase Order
Sponsored Class
Travel Trip
Banner Posting Document (i)
Budget Document Year
Created By
Created On Date
FI Accounting Document Fiscal Year
FI Accounting Line Item Number
FI Accounting Document Number (i)
FM Document Line Item
FM Document Number (i)
Header Text
Line Item Text
Long Text
PO Line Item Text
Purchasing Document Number (i)
Reference Document Fiscal Year
Reference Document Number (i)
Reversal Ref Document Number (i)
Degenerate Dimensions
10
GM MV Dimensions
Additional GM Document Attributes
Asset
Banner Detail Code
Business Area
Commitment Item
Cost Center
Fiscal Year Period
Functional Area
Fund
Funded Program
Funds Center
GL Account
GM Billing Customer
Grant
Order
Sponsored Class
Sponsored Program
Vendor
Work Breakdown Structure Element
FI Document Date
Financial Document Type
Material
Posting Date
Purchase Order
Travel Trip
Banner Posting Document (i)
Check Number
Created By
Created On
FI Accounting Document Line Item
FI Accounting Document Number (i)
GM Document Line Item
GM Document Number
Item Text
Reference Document Fiscal Year
Reference Document Number (i)
Degenerate Dimensions
11
CO MV Dimensions
Additional CO Document Attributes
Business Area
Cost Center
Cost Element
Employee
Fiscal Year Period
Functional Area
Fund
Grant
Order
Partner Cost Center
Partner Functional Area
Partner Fund
Partner Grant
Partner Order
Partner Work Activity Type
Source Cost Center
Source Work Activity Type
Work Activity Type
Document Date
Material
Posting Date
Purchase Order
CO Document Item Number (i)
CO Document Number
Created By
Created on Date
Document Header Text
Document Line Item
Line Item Text
Purchasing Document Number (i)
Reference Document Fiscal Year
Reference Document Number (i)
Reverse Document Reference Doc Number (i)
Degenerate Dimensions
12
13
Troubleshooting
TIP: Check everything that has already been discussed
above
TIP: If your query contains calculations, remove them one
at a time to find which is causing the problem; once it’s
isolated, you can focus on why it is a problem
TIP: If your query contains prompts remove them one at a
time to find which is causing the problem
TIP: If your query has complex logic (multiple joins,
unions, etc.) execute the pieces individually to find which
part is causing the problem
TIP: If you have a very serious performance problem,
contact the BICC
Questions?
14
Slide Note
Embed
Share

A meeting was held on 12/08/2015 with Gary Yates to discuss query performance tips for report writers. The session covered important aspects such as retrieving necessary fields, using single list views or crosstabs effectively, and keeping query calculations simple. Additionally, insights on partitioning data within fact tables and utilizing materialized views for improved access time were shared. Practical examples and tips on matching aggregations in materialized views were also provided to enhance query optimization.

  • Report Writers
  • Query Performance
  • Data Partitioning
  • Materialized Views
  • Business Intelligence

Uploaded on Feb 19, 2025 | 0 Views


Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

E N D

Presentation Transcript


  1. BUSINESS INTELLIGENCE COMPETENCY CENTER Common View Deep Understanding Better Decisions Query Performance Tips Report Writers Meeting Gary Yates 12/08/2015

  2. Easy Stuff TIP: Only retrieve the fields you actually need on your report (Especially if including extra fields from another dimension) TIP: Utilize a single list view or crosstab if possible (Each one you add even if you point it at the same query will execute the query again) TIP: Try to keep the calculations in your query as simple and efficient as possible 2

  3. Partitions The data in the largest fact tables are divided into partitions by date (i.e. they are really many tables) Six-month fiscal period partitions: Financial Accounting Fact Funds Management Fact Grants Management Fact Controlling Fact Fiscal year partitions: Financial Accounting Fact MV Funds Management Fact MV Grants Management Fact MV Controlling Fact MV Financial Balances Six-month posting date partitions: Payroll Charge Fact TIP: Always filter on a date attribute for these Use Fiscal Year Period for most, but Posting Date for Payroll Charge 3

  4. Materialized Views The four large financial fact tables have materialized views (MV) Materialized views pre-aggregate the facts to speed up access time They are used transparently if the database can determine that your query can be re-written to use the MV Not every field and dimension is in the materialized view Row Count (millions) 77% Smaller 115 27 4

  5. Materialized Views Your query doesn t just have to match the fields in the view, it also has to match the aggregations used in the view All of the views contain a total on each fact Examples: total(amount) total(expense) total(revenue) 5

  6. Materialized Views TIP: Write your query to use only the fields in the materialized view if possible TIP: Whenever doing a calculation you need to force the aggregation before doing the calculation Example 1: Bad Data Item calculation Revenue + Expense Cognos will make this total(Revenue + Expense) Good Data Item calculation total(Revenue) + total(Expense) Example 2: Bad Data Item calculation Revenue * -1 Cognos will make this total(Revenue * -1) Good Data Item calculation total(Revenue) * -1 6

  7. Degenerate Dimensions There are fields in the fact table that are not facts Examples: Facts Degenerate Dimensions 7

  8. Degenerate Dimensions TIP: Don t filter on a degenerate dimension that is not indexed (marked with (i) in following slides) Probably okay if you use some other indexed attribute AND a non-indexed degenerate dimension 8

  9. FI MV Dimensions Included in Aggregate Included in Aggregate Additional FI Document Attributes Asset Banner Detail Code Business Area Commitment Item Cost Center Cost Element Customer Fiscal Year Period Functional Area Fund Funded Program Funds Center GL Account Grant Order Payee/Payer Vendor Work Breakdown Structure Element Not Not- -included in Aggregate included in Aggregate Document Date Financial Document Type Material Posting Date Purchase Order Sponsored Class Travel Trip Banner Posting Document (i) Business Transaction Changed By Changed On Date Check Number (i) Clearing Document (i) Clearing Document Line Item Derived Funds Center Document Header Text Document Parked By FI Accounting Document Number (i) FI Accounting Line Item Number Line item Text Recurring Entry Document Number (i) Reverse Document Fiscal Year Reverse Document Number (i) Degenerate Dimensions 9

  10. FM MV Dimensions Included in Aggregate Included in Aggregate Additional FM Document Attributes Asset Banner Detail Code Business Area Commitment Item Customer Fiscal Year Period Functional Area Fund Funded Program Funds Center Grant Order Vendor Work Breakdown Structure Element Not Not- -included in Aggregate included in Aggregate Additional FM Budget Document Attributes FI Document Date Financial Document Type Material Posting Date Purchase Order Sponsored Class Travel Trip Banner Posting Document (i) Budget Document Year Created By Created On Date FI Accounting Document Fiscal Year FI Accounting Line Item Number FI Accounting Document Number (i) FM Document Line Item FM Document Number (i) Header Text Line Item Text Long Text PO Line Item Text Purchasing Document Number (i) Reference Document Fiscal Year Reference Document Number (i) Reversal Ref Document Number (i) Degenerate Dimensions 10

  11. GM MV Dimensions Included in Aggregate Included in Aggregate Additional GM Document Attributes Asset Banner Detail Code Business Area Commitment Item Cost Center Fiscal Year Period Functional Area Fund Funded Program Funds Center GL Account GM Billing Customer Grant Order Sponsored Class Sponsored Program Vendor Work Breakdown Structure Element Not Not- -included in Aggregate included in Aggregate FI Document Date Financial Document Type Material Posting Date Purchase Order Travel Trip Banner Posting Document (i) Check Number Created By Created On FI Accounting Document Line Item FI Accounting Document Number (i) GM Document Line Item GM Document Number Item Text Reference Document Fiscal Year Reference Document Number (i) Degenerate Dimensions 11

  12. CO MV Dimensions Included in Aggregate Included in Aggregate Additional CO Document Attributes Business Area Cost Center Cost Element Employee Fiscal Year Period Functional Area Fund Grant Order Partner Cost Center Partner Functional Area Partner Fund Partner Grant Partner Order Partner Work Activity Type Source Cost Center Source Work Activity Type Work Activity Type Not Not- -included in Aggregate included in Aggregate Document Date Material Posting Date Purchase Order CO Document Item Number (i) CO Document Number Created By Created on Date Document Header Text Document Line Item Line Item Text Purchasing Document Number (i) Reference Document Fiscal Year Reference Document Number (i) Reverse Document Reference Doc Number (i) Degenerate Dimensions 12

  13. Troubleshooting TIP: Check everything that has already been discussed above TIP: If your query contains calculations, remove them one at a time to find which is causing the problem; once it s isolated, you can focus on why it is a problem TIP: If your query contains prompts remove them one at a time to find which is causing the problem TIP: If your query has complex logic (multiple joins, unions, etc.) execute the pieces individually to find which part is causing the problem TIP: If you have a very serious performance problem, contact the BICC 13

  14. Questions? 14

Related


More Related Content

giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#