{"id":126889,"date":"2022-08-01T06:43:07","date_gmt":"2022-08-01T06:43:07","guid":{"rendered":"https:\/\/blog.finxter.com\/?p=530217"},"modified":"2022-08-01T06:43:07","modified_gmt":"2022-08-01T06:43:07","slug":"how-to-convert-avro-to-csv-in-python","status":"publish","type":"post","link":"https:\/\/sickgaming.net\/blog\/2022\/08\/01\/how-to-convert-avro-to-csv-in-python\/","title":{"rendered":"How to Convert Avro to CSV in Python?"},"content":{"rendered":"\n
\n
\n
\n
\n
<\/div>\n<\/p><\/div>\n
\n
<\/div>\n<\/p><\/div>\n
\n
<\/div>\n<\/p><\/div>\n
\n
<\/div>\n<\/p><\/div>\n
\n
<\/div>\n<\/p><\/div>\n<\/p><\/div>\n
\n
\n
<\/div>\n<\/p><\/div>\n
\n
<\/div>\n<\/p><\/div>\n
\n
<\/div>\n<\/p><\/div>\n
\n
<\/div>\n<\/p><\/div>\n
\n
<\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/div>\n
4\/5 – (1 vote) <\/div>\n<\/div>\n

\"\ud83d\udcac\" Question<\/strong>: How to convert an .avro<\/em> file to a .csv<\/em> file in Python?<\/p>\n

Solution<\/strong>:<\/p>\n

To convert an Avro file my_file.avro<\/code> to a CSV file my_file.csv<\/code>, create a CSV writer using the csv<\/code> module and iterate over all rows using the iterator<\/a> returned by fastavro.reader()<\/code>. Then write each row to a file using the writerow()<\/code> function.<\/p>\n

Here’s an example:<\/p>\n

from fastavro import reader\nimport csv with open('my_file.avro', 'rb') as file_object: csv_file = csv.writer(open(\"my_file.csv\", \"w+\")) head = True for x in reader(file_object): if head: # write header header = emp.keys() csv_file.writerow(header) head = False # write normal row csv_file.writerow(emp.values())<\/pre>\n
Related<\/strong>: This code is a modified and improved version of this<\/a> source.<\/p>\n
\"\ud83d\udca1\" Avro<\/strong> is a data serialization framework for RPCs (remote procedure calls) that uses JSON and binary format to serialize data.<\/p>\n
\"\ud83d\udca1\" CSV<\/strong> stands for comma-separated values, so you have a row-based file format where values are separated by commas, and the file is named using the suffix .csv<\/code>.<\/p>\n","protected":false},"excerpt":{"rendered":"
4\/5 – (1 vote) Question: How to convert an .avro file to a .csv file in Python? Solution: To convert an Avro file my_file.avro to a CSV file my_file.csv, create a CSV writer using the csv module and iterate over all rows using the iterator returned by fastavro.reader(). Then write each row to a file […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[857],"tags":[73,468,528],"class_list":["post-126889","post","type-post","status-publish","format-standard","hentry","category-python-tut","tag-programming","tag-python","tag-tutorial"],"_links":{"self":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/126889","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/comments?post=126889"}],"version-history":[{"count":0,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/126889\/revisions"}],"wp:attachment":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media?parent=126889"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/categories?post=126889"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/tags?post=126889"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}