¶ Description
Open many text files in separate cells.
¶ Parameters
¶ Parameters tab
Parameters:
- Column with files paths
- allow missing files
- Column with files paths
- Length to truncate content to (chars)
- file encoding
¶ Description tab
See dedicated page for more information.
¶ Code tab
readOneFilePerCell is a scripted action. Embedded code is accessible and customizable through this tab.
¶ Configuration tab
See dedicated page for more information.
¶ About
The readOneFilePerCell action reads the full content of each file specified in a column of the input table and places that content into a new column—one file per row/cell. This is useful when handling large-scale text files that need to be processed individually.
¶ Example Input Table
| filePath |
|---|
/data/logs/file1.txt |
/data/logs/file2.txt |
/data/logs/file3.txt |
¶ Example Output Table
| filePath | file content |
|---|---|
/data/logs/file1.txt |
Content of file1.txt |
/data/logs/file2.txt |
Content of file2.txt |
/data/logs/file3.txt |
Content of file3.txt |
¶ Use Cases
- Reading hundreds or thousands of text files into an ETL pipeline.
- Preprocessing documents for NLP tasks like entity recognition or sentiment analysis.
- Loading log files or text data from directories into a structured dataset.
- Preparing raw documents for annotation or machine learning workflows.
¶ Tips
- Set
maxLento limit how much text is loaded if files are very large. - Ensure proper encoding is selected (
utf-8orutf-16) to avoid content issues. - Enable
allowMissingif you're not sure all listed files exist.
Notes
- If
allowMissingis set to false, any missing file will cause the pipeline to fail.- Incorrect encoding can result in unreadable or empty file content.
- Useful for ETL processes where document-level granularity is required.
