Spark Pipeline

Spark Pipeline

Comments

Post a Comment

Popular posts from this blog

debugging JTX errors

In the PowerCenter Administration Console, set the following custom properties for the Integration Service Process JVMOption1 = -Xdebug JVMOption2 = -Xrunjdwp:transport=dt_socket,address=8300,server=y,suspend=n Complete the following steps to debug the java code of Java transformations in an Eclipse environment: In Eclipse, create a package named com.informatica.powercenter.server.jtx In Eclipse, create a class named JTXPartitionDriverImplGen In the PowerCenter Designer, copy the source code of the Java transformation you want to debug. To view the source code, go to the Java Code tab of the Java transformation and then select the full code option. Paste the source code into Eclipse. In Eclipse, create a Remote Java Application. To create a remote java application, select the class you created, click debug, right-click on Remote Java Application, and then choose New. Configure the host and port. Note: Configure the port number to be the same as the address parameter you defined in...
Read more

Informatica PowerCenter Repository tables

Informatica PowerCenter Repository tables I am sure every PowerCenter developer either has an intention or necessity to know about the Informatica metadata tables and where information is stored etc. For the starters, all the objects that we create in Informatica PowerCenter - let them be sources, targets, mappings, workflows, sessions, expressions, be it anything related to PowerCenter, will get stored in a set of database tables (call them as metadata tables or OPB tables or repository tables). * I want to know all the sessions in my folder that are calling some shell script/command in the Post-Session command task. * I want to know how many mappings have transformations that contain "STOCK_CODE" defined as a port. * I want to know all unused ports in my repository of 100 folders. In repositories where you have many number of sessions or workflows or mappings, it gets difficult to achieve this with the help of Informatica PowerCenter client tool...
Read more

different OPB tables

OPB_SUBJECT - PowerCenter folders table OPB_MAPPING - Mappings table OPB_TASK - Tasks table like sessions, workflow etc TASK_TYPE for session is 68 and that of the workflow is 71. OPB_SESSION - Session & Mapping linkage table OPB_TASK_ATT R - Task attributes tables OPB_WIDGET - Transformations table Usage: Use WIDGET_ID from this table to that of the WIDGET_ID of any of the tables to know the transformation name and the folder details. Use this table in conjunction with OPB_WIDGET_ATTR or OPB_WIDGET_EXPR to know more about each transformation etc. OPB_WIDGET_FIEL D - Transformation ports table Usage: Take the FIELD_ID from this table and match it against the FIELD_ID of any of the tables like OPB_WIDGET_DEP and you can get the corresponding information. OPB_WIDGET_ATTR - Transformation properties table Usage: Use the ATTR_ID of this table to that of the ATTR_ID of OPB_ATTR table to find what each attribute in this transformation means. OPB_EXPRESSION - Expressions table Usa...
Read more