{"id":126915,"date":"2022-08-02T11:16:12","date_gmt":"2022-08-02T11:16:12","guid":{"rendered":"https:\/\/blog.finxter.com\/?p=533759"},"modified":"2022-08-02T11:16:12","modified_gmt":"2022-08-02T11:16:12","slug":"how-to-convert-multiple-text-files-to-a-single-csv-in-python","status":"publish","type":"post","link":"https:\/\/sickgaming.net\/blog\/2022\/08\/02\/how-to-convert-multiple-text-files-to-a-single-csv-in-python\/","title":{"rendered":"How to Convert Multiple Text Files to a Single CSV in Python?"},"content":{"rendered":"\n
\n
\n
\n
\n
<\/div>\n<\/p><\/div>\n
\n
<\/div>\n<\/p><\/div>\n
\n
<\/div>\n<\/p><\/div>\n
\n
<\/div>\n<\/p><\/div>\n
\n
<\/div>\n<\/p><\/div>\n<\/p><\/div>\n
\n
\n
<\/div>\n<\/p><\/div>\n
\n
<\/div>\n<\/p><\/div>\n
\n
<\/div>\n<\/p><\/div>\n
\n
<\/div>\n<\/p><\/div>\n
\n
<\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/div>\n
5\/5 – (1 vote) <\/div>\n<\/div>\n

You can merge multiple text files to a single CSV file in Python by using the glob.glob('.\/*.txt')<\/code> expression to filter out all path names of text files in a given folder. Then iterate over all those path names and use the open()<\/a><\/code> function to read the file contents and write append them to the CSV.<\/p>\n

\n
\"\"
Example<\/strong>: merge those files<\/em><\/figcaption><\/figure>\n<\/div>\n

Here’s the simple example: <\/p>\n

import glob with open('my_file.csv', 'a') as csv_file: for path in glob.glob('.\/*.txt'): with open(path) as txt_file: txt = txt_file.read() + '\\n' csv_file.write(txt) <\/pre>\n
The resulting output CSV file shows that all text files have been merged:<\/p>\n
\"\"<\/figure>\n
You can replace the separator (e.g., from single empty space to comma) by using the txt.replace(' ', ',')<\/a><\/code> function before writing it in the CSV:<\/p>\n
import glob with open('my_file.csv', 'a') as csv_file: for path in glob.glob('.\/*.txt'): with open(path) as txt_file: txt = txt_file.read() + '\\n' txt = txt.replace(' ', ',') csv_file.write(txt) <\/pre>\n
The resulting CSV is neatly separated with comma characters:<\/p>\n
\"\"<\/figure>\n
In case you need some more advanced ways to convert the text files to the CSV, you may want to check out the Pandas read_csv()<\/a><\/code> function to read the CSV into a DataFrame.<\/p>\n
As soon as you have it as a DataFrame, you can do advanced processing such as merging<\/a>, column selection<\/a>, slicing<\/a>, etc.<\/p>\n
\"\ud83c\udf0d\" Related Tutorial<\/strong>: How to Read a CSV to a DataFrame?<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"
5\/5 – (1 vote) You can merge multiple text files to a single CSV file in Python by using the glob.glob(‘.\/*.txt’) expression to filter out all path names of text files in a given folder. Then iterate over all those path names and use the open() function to read the file contents and write append […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[857],"tags":[73,468,528],"class_list":["post-126915","post","type-post","status-publish","format-standard","hentry","category-python-tut","tag-programming","tag-python","tag-tutorial"],"_links":{"self":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/126915","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/comments?post=126915"}],"version-history":[{"count":0,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/126915\/revisions"}],"wp:attachment":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media?parent=126915"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/categories?post=126915"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/tags?post=126915"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}