Posts

Azure Data lake Gen 2 Suggestions

Ø   For blob storage, you organize a set of files/blobs under a container. In the Azure portal this is located in “Containers” under “Blob service”. It is called “Blob Containers” in both the portal and desktop Storage Explorer. For ADLS Gen2, you also use containers, located in the portal in “Containers” under “Data Lake Storage”. It is called “Blob Containers” in the desktop Storage Explorer but it is called “File Systems” in the portal Storage Explorer Ø   In the Azure portal, for blob storage, you can upload/access files by going to the storage account and choosing Containers (under “Blob service”) or by using the Storage Explorer (preview) in the portal.   For ADLS Gen2, Containers (under “Data Lake Storage”) has no functionality except to create a container (click “File system”), but you can use the portal Storage Explorer. However, that is limited (you can’t upload files or change access tiers), so you should use the desktop Azure Storage Explorer to upload fi...

Metadata Repository Query to Search for Truncate Table Option

select task_name, 'Truncate Target Table' ATTR, decode(attr_value,1,'Yes','No') Value from OPB_EXTN_ATTR OEA, REP_ALL_TASKS RAT where OEA.SESSION_ID=rat.TASK_ID and attr_id=9

Java transformation does not find the JAR

This error may occur if the Java transformation does not find the JAR file. Follow the user guide from resources tab. Please try the below steps: Please make sure that the JAR file path should have a jar file name like “C:\Informatica\9.5.1\server\infa_shared\Temp\ concat.jar ”. For compile time: Under settings of Java Transformation, the first classpath should be an absolute path on the server and second should be the absolute path of the client machine. Make sure that file exists in both the locations. However, classpath of the server is optional. For run time: In session properties > Properties tab > Java Classpath > Here, provide the absolute path from server machine. If you still face the same problem, provide the path only from client machine twice.

debugging JTX errors

In the PowerCenter Administration Console, set the following custom properties for the Integration Service Process JVMOption1 = -Xdebug JVMOption2 = -Xrunjdwp:transport=dt_socket,address=8300,server=y,suspend=n Complete the following steps to debug the java code of Java transformations in an Eclipse environment: In Eclipse, create a package named com.informatica.powercenter.server.jtx In Eclipse, create a class named JTXPartitionDriverImplGen In the PowerCenter Designer, copy the source code of the Java transformation you want to debug. To view the source code, go to the Java Code tab of the Java transformation and then select the full code option. Paste the source code into Eclipse. In Eclipse, create a Remote Java Application. To create a remote java application, select the class you created, click debug, right-click on Remote Java Application, and then choose New. Configure the host and port. Note: Configure the port number to be the same as the address parameter you defined in...

repository query to get the longest running session in Repository

select -- the SRC_ROWS may look big if joiner is used T.SUBJECT_AREA, T.INSTANCE_NAME, TRUNC(AVG(END_TIME-START_TIME)*24, 2) RUN_HOUR, MIN(T.START_TIME) START_TIME, SUM(L.SRC_SUCCESS_ROWS) SRC_ROWS, SUM(L.TARG_SUCCESS_ROWS) TGT_ROWS from REP_TASK_INST_RUN T, OPB_SESS_TASK_LOG L where T.run_err_code=0 and (T.END_TIME-T.START_TIME)>= 1/24 and T.START_TIME >= TRUNC(SYSDATE)-2/24 and T.INSTANCE_ID = L.INSTANCE_ID GROUP BY T.SUBJECT_AREA, T.INSTANCE_NAME Order By RUN_HOUR desc;

Find SQL override repository query

1. To know the SQL overrides in mapping Source Qualifier transformation or Lookup Overrides or Pre SQL or post SQL etc Below is the query that takes the workflow name & Folder name as input and gives you all the SQL overrides wherever they are in the workflow. select folder, wf_name,     sess_name, mapping_name,     transformation_name, attr_name,     line_no, sql_value     from (select f.subj_name folder,     wf.task_name wf_name,     sess.instance_name sess_name,     m.mapping_name mapping_name,     w_inst.instance_name transformation_name,     attr.line_no, attr.attr_value sql_value,     attr_type.attr_name attr_name,     row_number() over (partition by wf.task_name,     sess.instance_name,     m.mapping_name,     w_inst.instance_name,     attr.line_no, ...

different OPB tables

OPB_SUBJECT - PowerCenter folders table OPB_MAPPING - Mappings table OPB_TASK - Tasks table like sessions, workflow etc TASK_TYPE for session is 68 and that of the workflow is 71. OPB_SESSION - Session & Mapping linkage table OPB_TASK_ATT R - Task attributes tables OPB_WIDGET - Transformations table Usage: Use WIDGET_ID from this table to that of the WIDGET_ID of any of the tables to know the transformation name and the folder details. Use this table in conjunction with OPB_WIDGET_ATTR or OPB_WIDGET_EXPR to know more about each transformation etc. OPB_WIDGET_FIEL D - Transformation ports table Usage: Take the FIELD_ID from this table and match it against the FIELD_ID of any of the tables like OPB_WIDGET_DEP and you can get the corresponding information. OPB_WIDGET_ATTR - Transformation properties table Usage: Use the ATTR_ID of this table to that of the ATTR_ID of OPB_ATTR table to find what each attribute in this transformation means. OPB_EXPRESSION - Expressions table Usa...