We have requirement to update main table (>30millions) based on business rules & lookup files. There are 46 lookup files with different schema & business rule. The priority to update is set for each lookup file & it need to done accordingly.
In this case the update will happen in order: AA,XX,BB,ZZ
The solution which we can think is:
Main Table -->(Lookup AA.txt)-->tMap1--->(Lookup XX.txt)-->tMap2--->(Lookup BB.txt)-->tMap3--->(Lookup ZZ.txt)-->tMap4--->so on...
Is this approach feasible? Whether it is achievable with one tMap?
Please suggest optimum development approach for this scenario.
Whether it's possible in Talend to set priority for lookup files?