INFORMATICA2

Informatica PowerCenter 介绍 Informatica PowerCenter 是一个 ETL 工具 ETL (Extract Transform Load,抽取转换装载) 负责完成数据源数据向数据仓库导入的过程。是实施数据仓库项目中最重要的步骤。如果说数据仓库项目主题话模型是一座大厦的设计蓝图,数据是建造这个大厦的砖石的话,那么ETL 就相当于建设整个大厦的过程。在数据仓库项目中,系统设计中最难的部分是用 阅读详情

INFORMATICA INTERVIEW QUESTIONS ON UPDATE STRATEGY TRANSFORMATION

1. What is an update strategy transformation?

Update strategy transformation is used to flag source rows for insert, update, delete or reject within a mapping. Based on this flagging each row will be either inserted or updated or deleted from the target. Alternatively the row can be rejected.

2. Why update strategy is an active transformation?

As update strategy transformation can reject rows, it is called as an active transformation.

3. What are the constants used in update strategy transformation for flagging the rows?
  • DD_INSERT is used for inserting the rows. The numeric value is 0.
  • DD_UPDATE is used for updating the rows. The numeric value is 1.
  • DD_DELETE is used for deleting the rows. The numeric value is 2.
  • DD_REJECT is used for rejecting the rows. The numeric value is 3.

4. If you place an aggregator after the update strategy transformation, how the output of aggregator will be affected?

The update strategy transformation flags the rows for insert, update and delete of reject before you perform aggregate calculation. How you flag a particular row determines how the aggregator transformation treats any values in that row used in the calculation. For example, if you flag a row for delete and then later use the row to calculate the sum, the integration service subtracts the value appearing in this row. If the row had been flagged for insert, the integration service would add its value to the sum.

5. How to update the target table without using update strategy transformation?

In the session properties, there is an option 'Treat Source Rows As'. Using this option you can specify whether all the source rows need to be inserted, updated or deleted.

6. If you have an update strategy transformation in the mapping, what should be the value selected for 'Treat Source Rows As' option in session properties?

The value selected for the option is 'Data Driven'. The integration service follows the instructions coded in the update strategy transformation.

7. If you have an update strategy transformation in the mapping and you did not selected the value 'Data Driven' for 'Treat Source Rows As' option in session, then how the session will behave?

If you do not choose Data Driven when a mapping contains an Update Strategy or Custom transformation, the Workflow Manager displays a warning. When you run the session, the Integration Service does not follow instructions in the Update Strategy transformation in the mapping to determine how to flag rows.

8. In which files the data rejected by update strategy transformation will be written?

If the update strategy transformation is configured to Forward Rejected Rows then the integration service forwards the rejected rows to next transformation and writes them to the session reject file. If you do not select the forward reject rows option, the integration service drops rejected rows and writes them to the session log file. If you enable row error handling, the Integration Service writes the rejected rows and the dropped rows to the row error logs. It does not generate a reject file.

INFORMATICA PROBLEMS WITH SOLUTIONS - PART 1

1. In this problem we will see how to implement the not equal operator, greater than, greater than or equal to, less than and less than or equal to operators when joining two tables in informatica.

Consider the below sales table as an example?

Table name: Sales
product, prod_quantity, price , Year
A         , 10                 , 100  , 2010
B         , 15                 , 150  , 2010
A         , 8                   , 80    , 2011
B         , 26                 , 260  , 2011

Now the problem is to identify the products whose sales is less than in the current year (In this example: 2011) when compared to the last year.

Here in this example, Product A sold less in 2011 when compared with the sales in 2010.

This problem can be easily implemented with the help of SQL query as shown below
SELECT  cy.*
FROM    SALES cy,
                SALES py
WHERE   cy.product = py.product
AND        cy.year=2011
AND        py.year=2010
AND       cy.prod_quantity < py.prod_quantity;

In informatica, you can specify only equal to condition in joiner. Now we will see how to implement this problem using informatica.

Solution:

STEP1: Connect two source qualifier transformations to the source definition. Call the first source qualifier transformation as sq_cy  (cy means current year) and the other as sq_py  (py means previous year).

STEP2: In the sq_cy source qualifier transformation, specify the source filter as price=2011. In the sq_py, specify the source filter as price=2010

STEP3: Now connect these two source qualifier transformations to joiner transformation and make sq_cy as master, sq_py as detail. In the join condition, select the product port from master and detail.

STEP4: Now connect all the master ports and only the prod_quantity port from detail to the filter transformation. In the filter transformation specify the filter condition as prod_quantity < prod_quantity1. Here pord_quantity port is from master port and prod_quantity1 is from detail port.

STEP4: Connect all the ports except the prod_quantity1 of filter transformation to the target definition.

2. How to implement the not exists operator in informatica which is available in database?

Solution:

Implementing the Not Exists operator is very easy in informatica. For example, we want to get only the records which are available in table A and not in table B. For this use a joiner transformation with A as master and B as detail. Specify the join condition and in the join type, select detail outer join. This will get all the records from A table and only the matching records from B table.

Connect the joiner to a filter transformation and specify the filter condition as B_port is NULL. This will give the records which are in A and not in B. Then connect the filter to the target definition.

REVERSE THE CONTENTS OF FLAT FILE – INFORMATICA

Q1) I have a flat file, want to reverse the contents of the flat file which means the first record should come as last record and last record should come as first record and load into the target file. 

As an example consider the source flat file data as

Informatica Enterprise Solution
Informatica Power center
Informatica Power exchange
Informatica Data quality

The target flat file data should look as

Informatica Data quality
Informatica Power exchange
Informatica Power center
Informatica Enterprise Solution

Solution:

Follow the below steps for creating the mapping logic

  • Create a new mapping.
  • Drag the flat file source into the mapping.
  • Create an expression transformation and drag the ports of source qualifier transformation into the expression transformation.
  • Create the below additional ports in the expression transformation and assign the corresponding expressions

Variable port: v_count = v_count+1
Output port o_count = v_count

  • Now create a sorter transformation and drag the ports of expression transformation into it.
  • In the sorter transformation specify the sort key as o_count and sort order as DESCENDING.
  • Drag the target definition into the mapping and connect the ports of sorter transformation to the target.

Q2) Load the header record of the flat file into first target, footer record into second target and the remaining records into the third target.

The solution to this problem I have already posted by using aggregator and joiner. Now we will see how to implement this by reversing the contents of the file.

Solution:

  • Connect the source qualifier transformation to the expression transformation. In the expression transformation create the additional ports as mentioned above.
  • Connect the expression transformation to a router. In the router transformation create an output group and specify the group condition as o_count=1. Connect this output group to a target and the default group to sorter transformation.
  • Sort the data in descending order on o_count port.
  • Connect the output of sorter transformation to expression transformation (don’t connect o_count port).
  • Again in the expression transformation create the same additional ports mentioned above.
  • Connect this expression transformation to router and create an output group. In the output group specify the condition as o_count=1 and connect this group to second target. Connect the default group to the third group.

DIFFERENCE BETWEEN STOP AND ABORT IN INFORMATICA

You can stop or abort running workflow by one of the following ways:

  • Issuing stop of abort in the informatica workflow monitor
  • Issuing stop of abort command in pmcmd.
  • specifying in the control task.
Stopping or Aborting Task:

When you stop, the integration service first tries to stop processing the task. The integration service does not process other tasks that are in sequence. However it process the tasks that are in parallel to the task on which the stop or abort command is issued. If the Integration Service cannot stop the task, you can try to abort the task. When you abort a task, the Integration Service kills the process on the task. 

Stopping or Aborting a Session Task:

When you issue a stop command on a session, the integration service first stops reading the data from the sources. It continues processing and writing data to the targets and then commits the data.

Abort command is handled the same way as the stop command, except that the abort command has timeout period of 60 seconds. If the Integration Service cannot finish processing and committing data within the timeout period, it kills the DTM process and terminates the session.

Difference Between Stop and Abort:

When you run a session, it holds memory blocks in the OS. When issue a abort on the session, it kills the threads and leaves the memory blocks. This causes memory issues in the server and leads to poor performance. Some operating systems clean the lost memory blocks automatically. However most of the operating systems do not clean up these memory blocks. Stop is clean way of killing the sessions and cleans up the memory blocks.

PMCMD COMMAND USAGE IN INFORMATICA

Informatica provides four built-in command line programs or utilities to interact with the informatica features. They are: 
  • infacmd
  • infasetup
  • pmcmd
  • pmrep
This article covers only about the pmcmd command. The pmcmd is a command line utility provided by the informatica to perform the following tasks. 
  • Start workflows.
  • Start workflow from a specific task.
  • Stop, Abort workflows and Sessions.
  • Schedule the workflows.
How to use PMCMD Command in Informatica: 

1. Scheduling the workflow 

The pmcmd command syntax for scheduling the workflow is shown below: 
pmcmd scheduleworkflow -service informatica-integration-Service -d domain-name -u user-name -p password -f folder-name -w workflow-name

You cannot specify the scheduling options here. This command just schedules the workflow for the next run. 

2. Start workflow 

The following pmcmd command starts the specified workflow: 
pmcmd startworkflow -service informatica-integration-Service -d domain-name -u user-name -p password -f folder-name -w workflow-name

3. Stop workflow 

Pmcmd command to stop the infromatica workflow is shown below: 

pmcmd stopworkflow -service informatica-integration-Service -d domain-name -u user-name -p password -f folder-name -w workflow-name

4. Start workflow from a task 

You can start the workflow from a specified task. This is shown below: 
pmcmd startask -service informatica-integration-Service -d domain-name -u user-name -p password -f folder-name -w workflow-name -startfrom task-name

5. Stopping a task. 

The following pmcmd command stops the specified task instance: 
pmcmd stoptask -service informatica-integration-Service -d domain-name -u user-name -p password -f folder-name -w workflow-name task-name

6. Aborting workflow and task. 

The following pmcmd commands are used to abort workflow and task in a workflow: 
pmcmd abortworkflow -service informatica-integration-Service -d domain-name -u user-name -p password -f folder-name -w workflow-name

pmcmd aborttask -service informatica-integration-Service -d domain-name -u user-name -

视频教程-Informatica PowerCenter 10.2 权威指南中文版-ETL Informatica PowerCenter 10.2 权威指南中文版 2... 阅读详情

相关推荐

Informatica - MD5

在对数据进行增量抽取的时候,通常的方法是按照时间戳或者 Identity 字段来过滤历史数据。当然还有更加简便的方式,那就是 MD5加密函数,它可以跟他特定列或者整行数据进行hash处理成一个组32位/64位字符串。之后根据该哈希值来 SCD-2 类型抽取。 MD5有很多加密形式,不同的加密形式输出的结果是不一样的。之所以这么说是因为在 Informatica 里面使用 MD5 函数之后,在数据

Mike han 1282

Informatica update strategy transformation

更新策略组件: 标记你的数据进入target里面做什么操作,一般会和lookup配合使用,有时候用0,1,1代表 forward  rejected rows被选中,rejected row是输出在错误文件里,不想看到reject输出,将错误输出到文件,因为有时候数据库原因导致某些column不能update,reject就会output到错误文件里面供查看,在workflow的reject...

zhuxiaojaun的专栏 668

PSM-DID实战指南:Stata代码解析与案例应用

本文详细解析PSM-DID方法在Stata中的实战应用,从理论到代码实现全面覆盖。通过倾向得分匹配(PSM)和双重差分(DID)的结合,有效解决政策评估中的选择偏差问题。文章提供完整的Stata命令代码、样例数据处理技巧和案例应用,帮助研究者准确评估政策效果。

vulkan6gpu的博客 790

Informatica基础系列(二)——更新策略转换组件

今天讲一讲 Infa 的更新策略转换组件(Update Strategy Transformation),以下简称 UST。UST 能够通过条件对源数据进行筛选——个性化处理,比如:一部分数据执行插入,另一部分数据执行更新、删除、拒绝。

惜福的专栏 1万+

C#安装OpenCv及打开笔记本默认摄像头方法

C#安装OpenCv及打开笔记本默认摄像头方法

cg1135217680的博客 2572

网络设备调试指南:如何用MDIO Clause22/45协议读写Marvell MV88E6390寄存器

本文深入解析了如何通过MDIO Clause 22/45协议对Marvell MV88E6390交换芯片进行寄存器读写调试。文章详细对比了两种协议的本质区别与适用场景,并重点阐述了MV88E6390的直接与间接寻址策略,提供了实战代码示例与关键调试技巧,帮助网络工程师高效解决配置与通信问题。

tequila的博客 517

Update Strategy小记

UPDATE else INSERT有两种实现方法: 1、Properties下的Attribute将Treat source rows as 选为Update,同时Mapping里目标表的Atttribue的Insert选项勾上。 2、Properties下的Attribute将Treat source rows as 选为Data Driven,同时Mapping里目标表的Atttribu

一天不进步,就是退步. 6343

格(Lattice)基础(一)

有关格的基础概念,和相关的格难题

Amire0x的小乐园 5698

Informatica - Lookup transformation & Update Strategy Transformation

Lookup transformation: ports type: I: Input O: Output L: lookup R: Return ( for unconnected Lookup) 调用unconnected lookup tr

wujiandao的专栏 2020

不只是抓取:用五指灵巧手(ROH-A001/RH56)玩转ROS2下的力控与混合控制

本文深入探讨了在ROS2环境下使用五指灵巧手(ROH-A001/RH56)实现力控与混合控制的实战技巧。从硬件通信协议解析到ROS2节点开发,详细介绍了力感知架构、实时数据处理和混合控制策略,帮助开发者在Ubuntu系统中高效实现精密操作。通过鸡蛋抓取等实例,展示了力控技术在机器人灵巧操作中的关键作用。

weixin_28221501的博客 285

支付宝支付(三):周期扣款实现注意细节

一、周期扣款实现说明 1、官方文档入口:https://opendocs.alipay.com/open/20190319114403226822/intro 2、根据官方文档说明,周期扣款有两种方式:先签约后代扣场景和支付后签约场景 3、周期扣款接入问题文档: a>https://opendocs.alipay.com/support/01rg24 b>https://opensupport.alipay.com/support/knowledge/50249/20160248753

新鲜雾霾的博客 5691

Informatica 10.2.0 快速入门教程

Informatica 10.2.0 快速入门教程 【下载地址】Informatica10.2.0快速入门教程 本资源库提供《一看就会的Informatica10.2.0.pdf》,专为初学者设计,帮助您快速掌握Informatica 10.2.0的基本操作与应用。教程从安装配置入手,深入讲解Informatica的基本...

gitblog_06714的博客 289

web渗透学习手册

依据多年的渗透测试项目经验及个人理解,对漏洞分类

渗透之路,攻防之间皆学问 1万+

Type 2 Dimension Logic In Informatica

        This article will show a simple logic do the incremental loading of Type 2 dimension tables in Informatica.        1. Extract the changed data from the source to temp table.        There a

学习记录 548

025、空间降噪与时域降噪:噪声抑制与细节保留的平衡艺术

《降噪技术的平衡艺术:空间与时域降噪的协同优化》 本文深入探讨了图像处理中空间降噪与时域降噪的技术原理与工程实践。空间降噪通过像素级处理提升单帧质量,而时域降噪则利用帧间信息增强稳定性。文章揭示了两种方法在实际应用中的矛盾点:过度降噪会导致细节损失,影响后续算法性能。作者结合车载环视系统等实战案例,详细分享了参数调优经验,包括运动自适应策略、边缘保持技巧和嵌入式平台优化方案。特别强调降噪的最终目标应服务于下游算法需求,而非单纯追求图像美观。文章为工程人员提供了从理论到实践的完整指导,展现了降噪技术在效果与性

sundong_81的博客 186

android 蓝牙通讯demo

android 下蓝牙通讯demo,实现了发现蓝牙,使能蓝牙,通过蓝牙发送消息。

Informatica PowerCenter 10.2 权威指南中文版下载仓库

Informatica PowerCenter 10.2 权威指南中文版下载仓库 去发现同类优质开源项目:https://gitcode.com/ 在当前的大数据时代,掌握数据处理能力是至关重要的。而Informatica PowerCenter正是业界广泛使用的数据处理工具之一。本仓库提供的《Informatica PowerCenter 10.2 权威指南中文版》资源文件,旨在帮助您快速掌握该...

gitblog_06747的博客 438

Outlook Express 6 (OE6) for Win7/Win8/Win10

英文版 Outlook Express6.0, 兼容Win7/Win10/WinXP,解压就可用。

Informatica10.2.0快速入门教程:掌握数据集成与转换

Informatica10.2.0快速入门教程:掌握数据集成与转换 【下载地址】Informatica10.2.0快速入门教程 本资源库提供《一看就会的Informatica10.2.0.pdf》,专为初学者设计,帮助您快速掌握Informatica 10.2.0的基本操作与应用。教程从安装配置入手,深入讲解Inform...

gitblog_06795的博客 559

老版QQ原生表情gif动态

这是老版的QQ表情,不过全是动态的的,Windows照片查看器是不会动的,可以右击用浏览器打开查看,再说一遍是老版的,只是分享给宁愿用老版也要动态的人。

jdk-8u144-linux-x64.tar.gz.

该资源为搭建Linux系统Java环境用,资源的后缀为tar.gz格式的压缩包

windows server 2012 r2 环境部署informatica9.6.1

本文介绍了在windows server 2012 r2环境下部署informatica9.6.1的流程,安装基础为oracle11g数据库以及oracle32位客户端。

weixin_44774679的博客 1101

开启数据处理新篇章:Informatica PowerCenter 10.2 权威指南中文版资源库

开启数据处理新篇章:Informatica PowerCenter 10.2 权威指南中文版资源库 去发现同类优质开源项目:https://gitcode.com/ 在大数据浪潮中,数据处理技能的重要性无需多言。Informatica PowerCenter 10.2 权威指南中文版资源库,为您提供一站式学习解决方案,助您快速掌握数据处理核心工具。 项目介绍 Informatica PowerCe...

gitblog_06792的博客 688

Informatica学习:2、配置存储库服务和集成服务

阅读目录 1、创建存储库服务 2、创建集成服务 3、错误日志的查看 4、客户端连接   继续上一篇的1、安装介质的获取与安装,本文介绍服务端的存储库服务和集成服务的配置。   安装好Informatica的客户端和服务端后,需要登陆Administration Console,配置存储库服务(Powercenter Repository Service)和集成服务(Powercente...

runingman007的博客 1502

Informatica_(2)第一个例子

PowerCenter Repository Manager1.启动客户端程序连接服务器打开客户端(PowerCenter Repository Manager)PCRM;存储库--配置域--添加新域;填写域名(Domain_1)、网关主机(SC-201709251400)、网关端口后(6005),点“确定”;选中右边的存储库(BI),点“确定”;双击左边导航中的BI存储库,填写用户名、密码(ad...

weixin_30788731的博客 260

Informatica使用操作流程及Expression(表达式转换)案例2

操作流程: ①定义源<Odbc01_oracle:employees>; ②定义目标<EDW_EMPLOYEES>; ③创建映射<M_ORACLE_EDW01_employees>; ④定义任务<S_ORCL_EDW01_employees>; ⑤创建工作流<W_ORCL_EDW01_employees>; ⑥工作流调度监控; ⑦查验数据;

Jalen big data analysis的博客 1761

informatica server及client windows搭建流程961或10.2.0

961版本需要1个oracle,10.2.0版本需要2个oracle版本(模型库不可以与repository使用同一个oracle)1安装oracleLINUX客户端2写映射文件3.写入环境变量export#ORACLE客户端环境变量#sqlplus命令所在的路径PATH=PATHORABIN###使配置的环境变量生效验证方法oracle的用户类似于一个数据库。.........

weixin_38689747的博客 1386

informatica数据迁移之Sybase2Oracle

获取以Sybase为源或目标的表,修改表结构       1、源表很容易找到 目标表就杂乱无章了 2、获取以Sybase为目标库的表         首先查看Sybase下相关库的链接 然后导出所有工作流xml文件,提取目标映射 接着导出所有mapping xml文件根据映射名提取的目标表才是Sybase下特定模式的目标表 3、源和目标

dgl19881225的博客 897
上一篇: INFORMATICA1
下一篇: GENERATE DATE / TIME DIMENSION IN INFORMATICA
thy822
博客等级 码龄19年 313粉丝 294原创
评论
成就一亿技术人!
拼手气红包6.0元
还能输入1000个字符
 
 条评论被折叠 查看
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付:10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值