Skip to content

Commit 2fa06eb

Browse files
committed
add logging for files
1 parent 62f949e commit 2fa06eb

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

MaxText/input_pipeline/_grain_data_processing.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -36,6 +36,7 @@
3636
def find_data_files(data_file_pattern):
3737
data_files = glob.glob(str(Path(data_file_pattern).expanduser().resolve()))
3838
assert len(data_files) > 0, f"No file found with pattern {data_file_pattern}."
39+
max_logging.log(f"Found {len(data_files)} files for train/eval with grain")
3940
return data_files
4041

4142

0 commit comments

Comments
 (0)