Spark Pipeline

Spark Pipeline

Comments

Post a Comment

Popular posts from this blog

different OPB tables

OPB_SUBJECT - PowerCenter folders table OPB_MAPPING - Mappings table OPB_TASK - Tasks table like sessions, workflow etc TASK_TYPE for session is 68 and that of the workflow is 71. OPB_SESSION - Session & Mapping linkage table OPB_TASK_ATT R - Task attributes tables OPB_WIDGET - Transformations table Usage: Use WIDGET_ID from this table to that of the WIDGET_ID of any of the tables to know the transformation name and the folder details. Use this table in conjunction with OPB_WIDGET_ATTR or OPB_WIDGET_EXPR to know more about each transformation etc. OPB_WIDGET_FIEL D - Transformation ports table Usage: Take the FIELD_ID from this table and match it against the FIELD_ID of any of the tables like OPB_WIDGET_DEP and you can get the corresponding information. OPB_WIDGET_ATTR - Transformation properties table Usage: Use the ATTR_ID of this table to that of the ATTR_ID of OPB_ATTR table to find what each attribute in this transformation means. OPB_EXPRESSION - Expressions table Usa...
Read more

query to get relation connection details in Informatica

Below is the query to get relation connection details in Informatica. select * from V_PC8X_CONNECTION where CONNECTION_NAME IN (select DISTINCT CONNECTION_NAME from REP_SESSION_CNXS where SUBJECT_AREA='FOLDER_NAME');   If you want to get connection details used in particular folder then you need to pass the FOLDER_NAME as input to the above query. Above query will give details like Connection name, Host name, database type, user name, Connection string and more. select * from V_PC8X_CONNECTION where CONNECTION_NAME IN (select DISTINCT CONNECTION_NAME from REP_SESSION_CNXS where SUBJECT_AREA='FOLDER_NAME');    If you want to get connection details used in particular folder then you need to pass the FOLDER_NAME as input to the above query. Above query will give details like Connection name, Host name, database type, user name, Connection string and more. Informatica Repository Queries to get connection names, command tasks and event wait file names  Query to ge...
Read more

repository query to get the longest running session in Repository

select -- the SRC_ROWS may look big if joiner is used T.SUBJECT_AREA, T.INSTANCE_NAME, TRUNC(AVG(END_TIME-START_TIME)*24, 2) RUN_HOUR, MIN(T.START_TIME) START_TIME, SUM(L.SRC_SUCCESS_ROWS) SRC_ROWS, SUM(L.TARG_SUCCESS_ROWS) TGT_ROWS from REP_TASK_INST_RUN T, OPB_SESS_TASK_LOG L where T.run_err_code=0 and (T.END_TIME-T.START_TIME)>= 1/24 and T.START_TIME >= TRUNC(SYSDATE)-2/24 and T.INSTANCE_ID = L.INSTANCE_ID GROUP BY T.SUBJECT_AREA, T.INSTANCE_NAME Order By RUN_HOUR desc;
Read more