Spark Pipeline

Spark Pipeline

Comments

Post a Comment

Popular posts from this blog

different OPB tables

OPB_SUBJECT - PowerCenter folders table OPB_MAPPING - Mappings table OPB_TASK - Tasks table like sessions, workflow etc TASK_TYPE for session is 68 and that of the workflow is 71. OPB_SESSION - Session & Mapping linkage table OPB_TASK_ATT R - Task attributes tables OPB_WIDGET - Transformations table Usage: Use WIDGET_ID from this table to that of the WIDGET_ID of any of the tables to know the transformation name and the folder details. Use this table in conjunction with OPB_WIDGET_ATTR or OPB_WIDGET_EXPR to know more about each transformation etc. OPB_WIDGET_FIEL D - Transformation ports table Usage: Take the FIELD_ID from this table and match it against the FIELD_ID of any of the tables like OPB_WIDGET_DEP and you can get the corresponding information. OPB_WIDGET_ATTR - Transformation properties table Usage: Use the ATTR_ID of this table to that of the ATTR_ID of OPB_ATTR table to find what each attribute in this transformation means. OPB_EXPRESSION - Expressions table Usa...
Read more

query to get relation connection details in Informatica

Below is the query to get relation connection details in Informatica. select * from V_PC8X_CONNECTION where CONNECTION_NAME IN (select DISTINCT CONNECTION_NAME from REP_SESSION_CNXS where SUBJECT_AREA='FOLDER_NAME');   If you want to get connection details used in particular folder then you need to pass the FOLDER_NAME as input to the above query. Above query will give details like Connection name, Host name, database type, user name, Connection string and more. select * from V_PC8X_CONNECTION where CONNECTION_NAME IN (select DISTINCT CONNECTION_NAME from REP_SESSION_CNXS where SUBJECT_AREA='FOLDER_NAME');    If you want to get connection details used in particular folder then you need to pass the FOLDER_NAME as input to the above query. Above query will give details like Connection name, Host name, database type, user name, Connection string and more. Informatica Repository Queries to get connection names, command tasks and event wait file names  Query to ge...
Read more

Find SQL override repository query

1. To know the SQL overrides in mapping Source Qualifier transformation or Lookup Overrides or Pre SQL or post SQL etc Below is the query that takes the workflow name & Folder name as input and gives you all the SQL overrides wherever they are in the workflow. select folder, wf_name,     sess_name, mapping_name,     transformation_name, attr_name,     line_no, sql_value     from (select f.subj_name folder,     wf.task_name wf_name,     sess.instance_name sess_name,     m.mapping_name mapping_name,     w_inst.instance_name transformation_name,     attr.line_no, attr.attr_value sql_value,     attr_type.attr_name attr_name,     row_number() over (partition by wf.task_name,     sess.instance_name,     m.mapping_name,     w_inst.instance_name,     attr.line_no, ...
Read more