Talend Exchange is the place where Talend community can share items related to Talend opensource products, such as Data Integration, Data Quality and Data Master Management. Contribution is open to any user, no specific validation is needed. As soon as you have your forum account, you automatically get a Talend Exchange account.


Show

Category
Search
Version
Author
 

Statistics

  • 607 extensions
  • 913 revisions
  • 296 contributors
  • 156229 downloads
 

Top Contributors

Version Author Released on Rating Downloads
Component

tGoogle

1.0 Lesego 2014-08-28
0

Component

tPostgresqlTableTransfer

1.8 jlolling 2014-08-27
1

This component is dedicated to transfer the table content from one database to another database.
The component can truncate the target table before.
This component does not care about schema differences. All columns existing in source and target table will be transferred, all other ignored. The necessary schema will be created internally, therefore you have to provide only the source and target table name, thats it.
The component uses asynchronous transfer to half the duration because reading and writing can take place at the same time (or overlapping).

Component

tOracleTableTransfer

1.8 jlolling 2014-08-27
3

This component is dedicated to transfer the table content from one database to another database.
The component can truncate the target table before.
This component does not care about schema differences. All columns existing in source and target table will be transferred, all other ignored. The necessary schema will be created internally, therefore you have to provide only the source and target table name, thats it.
The component uses asynchronous transfer to half the duration because reading and writing can take place at the same time (or overlapping).

Component

tDB2TableTransfer

1.8 jlolling 2014-08-27
1

This component is dedicated to transfer the table content from one database to another database.
The component can truncate the target table before.
This component does not care about schema differences. All columns existing in source and target table will be transferred, all other ignored. The necessary schema will be created internally, therefore you have to provide only the source and target table name, thats it.
The component uses asynchronous transfer to half the duration because reading and writing can take place at the same time (or overlapping).

Component

tMysqlTableTransfer

1.8 jlolling 2014-08-27
2

This component is dedicated to transfer the table content from one database to another database.
The component can truncate the target table before or disable all constraints while importing the data.
This component does not care about schema differences. All columns existing in source and target table will be transferred, all other ignored. The necessary schema will be created internally, therefore you have to provide only the source and target table name, thats it.
The component uses asynchronous transfer to half the duration because reading and writing can take place at the same time (or overlapping).

Component

tHTMLParse

0.2 tal00000 2014-08-26
18

This component fetches and parses an HTML document with help from the excellent Java library jsoup (jsoup.org).

A number of elements are extracted from the document together with useful information including the fetch time.

Some elements, for example, Hyperlinks are made available through the jsoup class Elements, allowing you to use the power of jsoup to process these as you wish. When I have time, I\'ll write some supplemental components that will iterate through these Elements; however, it\'s simple enough to do this yourself using a component such as tJavaFlex.

The entire document is also made available through the jsoup Document class, allowing you full control over the document.

Component

tMemoryMonitor

0.1 tal00000 2014-08-22
63

Monitor the memory usage of your running Job, with tMemoryMonitor

Information on the used, total and maximum (see -Xmx) memory of the Java runtime, are written to standard output or, if a warning threshold is reached, to standard error.

Options include \'Enabled\', \'Interval\' (milliseconds) and \'Warning Threshold Percent %\'.

Used in conjunction with your own diagnostic messages, this component will help you to identify where memory is being used within your Job an help you to avoid Out of Memory (OOM) Exceptions.

As well as ensuring that your Job has enough memory, you\'ll also want to make sure that you do not waste system memory. The Talend Job defaults are -Xms256MB and -Xmx1024MB. As well as some of your Jobs requiring more that 1024MB, some will require less that 256MB. This utility will allow you to observe the peak memory usage and to tune accordingly.

For more information on Java Runtime memory reporting, read http://docs.oracle.com/javase/7/docs/api/java/lang/Runtime.html.

Used memory is totalMemory - freeMemory. Percentages are based on used memory vs. maxMemory.

This component also reports the number of available processors.

Sample output.

tMemoryMonitor_1: using 43MB/246MB (max=910MB/5%) (processors=4)
tMemoryMonitor_1: using 91MB/310MB (max=910MB/10%) (processors=4)
tMemoryMonitor_1: using 260MB/449MB (max=910MB/29%) (processors=4)
tMemoryMonitor_1: using 189MB/442MB (max=910MB/21%) (processors=4)
tMemoryMonitor_1: using 259MB/454MB (max=910MB/28%) (processors=4)
tMemoryMonitor_1: using 216MB/577MB (max=910MB/24%) (processors=4)

Component

tJobInstance* component collection

3.2 jlolling 2014-08-19
31

These 4 components:
- tJobInstanceStart
- tJobInstanceEnd
- tJobDataRangeScanner
- tJobInstanceLiveCheck
are dedicated to manage job monitoring.
These components provides following features:
* Creates an job instance Id to mark the datasets for data lineage
* holds all necessary information about a job run in a table
* keeps all context variables in a table (at the job start and its end)
* keeps as much as needed counters from the job
* provides incremental loads
* provides a lot of key figures about the last job run
* keeps the error messages from the job in the status table
* enables Log4J for the job with various outputs
Please refer the linked documentation
The release 3.0 needs slightly changed tables!
Please contact me in case of questions and do not use the rating function to post questions.

Component

tTimeGenerator

1.0 Sanjay Tiwari 2014-08-12
6

Component

tOpenerpOut

1.0 popeye 2014-08-12
10

Show

Category
Search
Version
Author
 

Statistics

  • 143 extensions
  • 207 revisions
  • 38 contributors
  • 17702 downloads
 

Top Contributors

Version Author Released on Rating Downloads
Regex

Temperature in Celsius

1.0 scorreia 2014-08-18
5

Check that a given number is a valid temperature in Celsius.

Regex

Companies House

4.0 mhallam 2014-07-29
65

This Regular Expression is used to match the Companies House 503 Reference number that is given when a customer places an online order.www.companieshouse.gov.uk

Regex

Bulgaria Vat Number

4.0 mhallam 2014-07-29
55

Vat number for Bulgaria. Formats are
BG123456789
BG1234567890

Regex

Austria VAT Number

4.0 mhallam 2014-07-29
71

mysql

Regex

Complex Australian Phone Number

4.0 mhallam 2014-07-29
69

Australian phone number validator. Accepts all forms of Australian phone numbers in different formats (area code in brackets, no area code, spaces between 2-3 and 6-7th digits, +61 international dialing code). Checks that area codes are valid (when entered).

Regex

Bank Routing Transit Number (RTN)

4.0 mhallam 2014-07-29
66

Ensures a given string matches the basic pattern of a bank routing transit number (RTN), used to identify financial institutions on instruments such as checks. Ensures number is nine digits long and has first two digits that comply with American Bankers Association rules.

Regex

ISBN Checker

4.0 mhallam 2014-07-29
85

Expression to check for a valid ISBN number

Regex

International Passport

4.0 mhallam 2014-07-29
61

? 9 characters made up of a combination of numbers and/or letters. Where less than 9 characters it will be padded out to the right with chevrons (

Regex

UK Vehicle Registration Plate Number Plate

4.0 mhallam 2014-07-29
85

AB12 RCY|||CD07 TES|||S33 GTT|||Y999 FVBab12 rcy|||CD07 TIS|||S34 GTT|||Z999 FVB

UK Vehicle Registration Plate / Number Plate format as specified by the DVLA. Accepts both "Prefix" and "New" style. Allows only valid DVLA number combinations as not all are supported. Registration number must be exactly as is displayed on car, hence all letters must be in uppercase and a space seperating the two sets of characters.

Regex

Swedish Personal Nr (Personnummer)

4.0 mhallam 2014-07-29
95

Simple regex for the Swedish personal number. It's in the form: YYMMDD-xxxx where xxxx is an arbitrary number from 0000-9999.

791231-1234

Show

Category
Search
Version
Author
 

Statistics

  • 5 extensions
  • 7 revisions
  • 4 contributors
  • 4016 downloads
 

Top Contributors

Version Author Released on Rating Downloads
Export

Product Demo

3.0 ctoum 2012-05-31
610

Product & families, with Cafepress pictures.

Data-Model

Clinical Trials: Janus Model Basics

1.0 jaymce 2010-11-22
403

This is a model of the basic of the Janus Clinical Data Repository.
http://www.fda.gov/ForIndustry/DataStandards/StudyDataStandards/ucm155327.htm

Data-Model

D* Demo Model

1.0 ctoum 2010-08-13
742

Model used in the D* Demo.

Export

Talendshop Demo

1.0 ctoum 2010-08-04
1131

Talendshop Demo (Demo Project)


95 ms