{"id":135458,"date":"2025-12-29T11:17:42","date_gmt":"2025-12-29T11:17:42","guid":{"rendered":"https:\/\/blog.finxter.com\/?p=1671633"},"modified":"2025-12-29T11:17:42","modified_gmt":"2025-12-29T11:17:42","slug":"the-json-trick-how-to-scrape-all-answers-in-a-subreddit-example-find-user-needs","status":"publish","type":"post","link":"https:\/\/sickgaming.net\/blog\/2025\/12\/29\/the-json-trick-how-to-scrape-all-answers-in-a-subreddit-example-find-user-needs\/","title":{"rendered":"The JSON Trick \u2013 How to Scrape All Answers in a Subreddit? (Example Find User Needs)"},"content":{"rendered":"<p><strong>Step 1<\/strong>: Open a subreddit with lots of comments and answers relevant to your niche.<\/p>\n<p><strong>Step 2<\/strong>: Append &#8220;.json&#8221; to the URL<\/p>\n<ul class=\"wp-block-list\">\n<li>Example Subreddit URL: <a href=\"https:\/\/www.reddit.com\/r\/GeminiAI\/comments\/1pyi6ax\/how_to_tell_if_an_image_is_ai_generated\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.reddit.com\/r\/GeminiAI\/comments\/1pyi6ax\/how_to_tell_if_an_image_is_ai_generated<\/a><\/li>\n<li>Example JSON: <a href=\"https:\/\/www.reddit.com\/r\/GeminiAI\/comments\/1pyi6ax\/how_to_tell_if_an_image_is_ai_generated.json\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/www.reddit.com\/r\/GeminiAI\/comments\/1pyi6ax\/how_to_tell_if_an_image_is_ai_generated<strong>.json<\/strong><\/a><\/li>\n<\/ul>\n<p><strong>Step 3<\/strong>: Copy and paste the whole JSON data into ChatGPT\/Gemini\/Claude<\/p>\n<p><strong>Step 4<\/strong>: Prompt something like this to discover user needs:<\/p>\n<pre class=\"wp-block-code\"><code>Look at this Subreddit (JSON format). Find and list all user pain points, needs, and struggles. Suggest top products and unique selling propositions (USPs) to satisfy these needs. Research similar products and find unique positions.<\/code><\/pre>\n<p>Here&#8217;s a sample output on my ChatGPT 5.2 Thinking:<\/p>\n<figure class=\"wp-block-image size-full\"><img fetchpriority=\"high\" decoding=\"async\" width=\"832\" height=\"1022\" src=\"https:\/\/blog.finxter.com\/wp-content\/uploads\/2025\/12\/image-49.png\" alt=\"\" class=\"wp-image-1671636\" srcset=\"https:\/\/blog.finxter.com\/wp-content\/uploads\/2025\/12\/image-49.png 832w, https:\/\/blog.finxter.com\/wp-content\/uploads\/2025\/12\/image-49-244x300.png 244w, https:\/\/blog.finxter.com\/wp-content\/uploads\/2025\/12\/image-49-768x943.png 768w\" sizes=\"(max-width: 832px) 100vw, 832px\" \/><\/figure>\n<p>It also shows a number of products that would fill these needs:<\/p>\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"811\" height=\"1024\" src=\"https:\/\/blog.finxter.com\/wp-content\/uploads\/2025\/12\/image-50-811x1024.png\" alt=\"\" class=\"wp-image-1671637\" srcset=\"https:\/\/blog.finxter.com\/wp-content\/uploads\/2025\/12\/image-50-811x1024.png 811w, https:\/\/blog.finxter.com\/wp-content\/uploads\/2025\/12\/image-50-238x300.png 238w, https:\/\/blog.finxter.com\/wp-content\/uploads\/2025\/12\/image-50-768x969.png 768w, https:\/\/blog.finxter.com\/wp-content\/uploads\/2025\/12\/image-50.png 855w\" sizes=\"auto, (max-width: 811px) 100vw, 811px\" \/><\/figure>\n<p>I omit the rest for brevity &#8211; you get the point. <\/p>\n<p>This truly is a goldmine of business need analysis.<\/p>\n<p>The post <a href=\"https:\/\/blog.finxter.com\/the-json-trick-how-to-scrape-all-answers-in-a-subreddit-example-find-user-needs\/\">The JSON Trick &#8211; How to Scrape All Answers in a Subreddit? (Example Find User Needs)<\/a> appeared first on <a href=\"https:\/\/blog.finxter.com\">Be on the Right Side of Change<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Step 1: Open a subreddit with lots of comments and answers relevant to your niche. Step 2: Append &#8220;.json&#8221; to the URL Example Subreddit URL: https:\/\/www.reddit.com\/r\/GeminiAI\/comments\/1pyi6ax\/how_to_tell_if_an_image_is_ai_generated Example JSON: https:\/\/www.reddit.com\/r\/GeminiAI\/comments\/1pyi6ax\/how_to_tell_if_an_image_is_ai_generated.json Step 3: Copy and paste the whole JSON data into ChatGPT\/Gemini\/Claude Step 4: Prompt something like this to discover user needs: Look at this Subreddit (JSON [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[857],"tags":[73,468,528],"class_list":["post-135458","post","type-post","status-publish","format-standard","hentry","category-python-tut","tag-programming","tag-python","tag-tutorial"],"_links":{"self":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/135458","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/comments?post=135458"}],"version-history":[{"count":0,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/135458\/revisions"}],"wp:attachment":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media?parent=135458"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/categories?post=135458"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/tags?post=135458"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}