0002539: tJoin : to perform inner or outer join between the main data flow and a lookup table

Viewing Issue Advanced Details [ Jump to Notes ]

[ Issue History ] [ Print ]

Category

Severity

Reproducibility

Date Submitted

Last Update

0002539

[Talend Open Studio] Perl components

feature

always

2007-11-26 17:53

2008-01-15 16:57

Reporter

rbillerey

View Status

public

Assigned To

rbillerey

Priority

normal

Resolution

fixed

Platform

Status

closed

Projection

none

OS Version

ETA

none

Fixed in Version

2.3.0M2

Product Version

Target Version

Product Build

Summary

0002539: tJoin : to perform inner or outer join between the main data flow and a lookup table

Description

The component schema is defined by :

- a selection of input columns
- a selection of lookup columns

Mapping with input columns is implicit ( name based ).
Mapping with lookup columns is explicit ( output column -> lookup column )

Lookup key is defined by the schema key attribute.

Input columns to join with the lookup key are optionaly different from the schema key.

Default join type is outer join. When join type is inner join, the reject link logs input rows without lookup matching rows.

The first version of this component has the following limitations :

- one lookup
- in memory lookup ( using hash table )

A second version will support persistent hash tables using a Berkeley DB hash file. This feature will perform lower speed lookup because lookup table is not entirely loaded in memory. The pro is the ability to use huge lookup tables ( more than 1M rows ).

Steps To Reproduce

Additional Information

Tags

No tags attached.

generated language

perl

workload (in half days)

Attached Files

Relationships

related to

0002692

closed

mhirt

Java tJoin component

Notes
(0005695) rbillerey (developer) 2007-12-12 18:05	Feature added on trunk in [Subversion, tos] r7553 with its test unit job

Issue History
Date Modified	Username	Field	Change
2007-11-26 17:53	rbillerey	New Issue
2007-11-26 17:53	rbillerey	Status	new => feedback from Talend
2007-11-26 17:53	rbillerey	Assigned To	=> rbillerey
2007-11-26 17:53	rbillerey	generated language	=> perl
2007-11-27 09:08	pdelebarre	Issue Monitored: pdelebarre
2007-11-27 10:06	plegall	Status	feedback from Talend => assigned
2007-12-12 18:05	rbillerey	Status	assigned => resolved/needs doc
2007-12-12 18:05	rbillerey	Fixed in Version	=> 2.3.0M2
2007-12-12 18:05	rbillerey	Resolution	open => fixed
2007-12-12 18:05	rbillerey	Note Added: 0005695
2008-01-10 13:23	asmae	Issue Monitored: asmae
2008-01-15 13:55	mhirt	Relationship added	related to 0002692
2008-01-15 16:57	plegall	Status	resolved/needs doc => closed

Mantis 1.1.6[^]