There are two different ways to load data in dimension tables.
Conventional (Slow) : All the constraints and keys are validated against the data before, it is loaded, this way data integrity is maintained.
Direct (Fast) : All the constraints and keys are disabled before the data is loaded. Once data is loaded, it is validated against all the constraints and keys. If data is found invalid or dirty it is not included in index and all future processes are skipped on this data.
Powercenter is data integration software of Informatica Corporation which provides an environment that allows to load data into a centralized location such as data warehouse. Data can be extracted from multiple sources can be trformed according to the business logic and can be loaded into files and relation targets.
OLTP is abbreviation of On-Line Traction Processing. This system is an application that modifies data the instance it receives and has a large number of concurrent users.
Dimensional table contains textual attributes of measurements stored in the facts tables. Dimensional table is a collection of hierarchies, categories and logic which can be used for user to traverse in hierarchy nodes.
AN mapplet is a reusable object that contains a set of trformations and enables to reuse that trformation logic in multiple mappings.
Following are ways to remove duplicate records
Use following query
SELECT MAPPING_NAME FROM REP_ALL_MAPPINGS WHERE
SUBJECT_AREA='YOUR_FOLDER_NAME' AND PARENT_MAPPING_IS_VALIED <>1
A trformation is a repository object that generates, modifies or passes data. Trformations in a mapping represent the operations the Integration Service performs on the data. Data passes through trformation ports that are linked in a mapping or mapplet.
OLAP is abbreviation of Online Analytical Processing. This system is an application that collects, manages, processes and presents multidimensional data for analysis and management purposes.
Dimensional data model concept involves two types of tables and it is different from the 3rd normal form. This concepts uses Facts table which contains the measurements of the business and Dimension table which contains the context(dimension of calculation) of the measurements.
A data warehouse is the main repository of an organization’s historical data, its corporate memory. It contains the raw material for management’s decision support system. The critical factor leading to the use of a data warehouse is that a data analyst can perform complex queries and analysis, such as data mining, on the information without slowing down the operational systems. Data warehousing collection of data designed to support management decision making. Data warehouses contain a wide variety of data that present a coherent picture of business conditions at a single point in time. It is a repository of integrated information, available for queries and analysis.
It’s a matter of awareness and the problem becoming urgent. We are seeing budgets increased and greater success in closing deals, particularly in the pharmaceutical and financial services industries. For rester predicts MDM will be $6 billion market by 2010, which is a 60-percent growth rate over the $1 billion MDM market last year. Gartner forecasts that 70 percent of Global 2000 companies will have a MDM solution by the year 20@These are pretty big numbers.
A Mapping parameter is a static value that you define before running the session and it value remains till the end of the session.when we run the session PowerCenter evaluates the value from the parameter and retains the same value throughout the session. When the session run again it reads from the file for its value.
A Mapping variable is dynamic or changes anytime during the session. PowerCenter reads the initial value of the variable before the start of the session and changes its value by using variable functions and before ending the session its saves the current value (last value held by the variable). Next time when the session runs the variable value is the last saved value in the previous session.
Offline Operational Databases : Data warehouses in this initial stage are developed by simply copying the database of an operational system to an off-line server where the processing load of reporting does not impact on the operational system’s performance.
Offline Data Warehouse: Data warehouses in this stage of evolution are updated on a regular time cycle (usually daily, weekly or monthly) from the operational systems and the data is stored in an integrated reporting-oriented data structure.
Real Time Data Warehouse:Data warehouses at this stage are updated on a traction or event basis, every time an operational system performs a traction (e.g. an order or a delivery or a booking etc.)
Integrated Data Warehouse : Data warehouses at this stage are used to generate activity or tractions that are passed back into the operational systems for use in the daily activity of the organization.
Technical folks often have a challenge in data governance in selling the project and getting the funding. Management is looking for return on investment; they need MDM tied to quantifiable benefits that business leaders understand, like dollar amounts around ROI.
Standalone Repository : A repository which functions individually and is unrelated to any other repositories.
Global Repository : This is a centralized repository in a domain. This repository can contain shared objects across the repositories in a domain. The objects are shared through global shortcuts.
Local Repository : Local repository is within a domain . Local repository can connect to a global repository using global shortcuts and can use objects in it’s shared folders.
A mapping is a set of source and target definitions linked by trformation objects that define the rules for data trformation. Mappings represent the data flow between sources and targets.
Following are the various components of Informatica PowerCenter,
Data Mining is the process of analyzing data from different perspectives and summarizing it into useful information.
Data movement modes determines how power center server handles the character data. We choose the data movement in the informatica server configuration settings. Two types of data movement modes available in informatica.
Master data management (MDM) is a comprehensive method of enabling an enterprise to link all of its critical data to one file, called a master file, that provides a common point of reference. When properly done, MDM streamlines data sharing among personnel and departments.
Fact table contains measurements of business processes also fact table contains the foreign keys for the dimension tables. For example, if your business process is “paper production” then “average production of paper by one machine” or “weekly production of paper” would be considered as measurement of business process.