{"id":4905,"date":"2020-07-29T02:28:04","date_gmt":"2020-07-29T02:28:04","guid":{"rendered":"https:\/\/www.novonon.com\/blog\/?p=4905"},"modified":"2020-07-29T02:28:04","modified_gmt":"2020-07-29T02:28:04","slug":"gwern-branwens-typically-comprehensive-look-at-gpt-3","status":"publish","type":"post","link":"https:\/\/www.novonon.com\/blog\/2020\/07\/29\/gwern-branwens-typically-comprehensive-look-at-gpt-3\/","title":{"rendered":"Gwern Branwen&#8217;s typically comprehensive look at GPT-3"},"content":{"rendered":"<blockquote><p>I think we need to discuss philosophy and learn different views, not refuse to talk to each other and perpetually believe we\u2019re right. What happens when a field of engineers gets outcast from its ideas because it\u2019s viewed as self-serving, or a religion changes its dogma to click bait? What happens when corporate mothers refuse to allow artists to express their own distinctive values? Scott Alexander is correct: if some features occur in naturally occurring systems all the time, then they are features of all desirable systems. It\u2019s not a coincidence that a religion, an organism, a mob of lion fish, and a stock market all look alike; it\u2019s just that as time goes on they all get more complicated and so they look more dissimilar. There are typically relatively featureless seed entities (an exploit, a convert, a founder) and then elaborations and permutations that go on according to the users who follow the ideas and put them to use. It\u2019s not a coincidence that the big disasters of technology in the past couple centuries have been from relatively simple systems that someone can just launch some malicious exploit at and start getting new permutations to exploit without having to get new ideas first.<\/p><\/blockquote>\n<p><em><a href=\"https:\/\/www.gwern.net\/GPT-3\">GPT-3 Creative Fiction \u00b7 Gwern.net<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>I think we need to discuss philosophy and learn different views, not refuse to talk to each other and perpetually believe we\u2019re right. What happens when a field of engineers gets outcast from its ideas because it\u2019s viewed as self-serving, or a religion changes its dogma to click bait? What happens when corporate mothers refuse [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false},"version":2}},"categories":[1],"tags":[],"class_list":["post-4905","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p3pfIY-1h7","jetpack_sharing_enabled":true,"jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/www.novonon.com\/blog\/wp-json\/wp\/v2\/posts\/4905","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.novonon.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.novonon.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.novonon.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.novonon.com\/blog\/wp-json\/wp\/v2\/comments?post=4905"}],"version-history":[{"count":1,"href":"https:\/\/www.novonon.com\/blog\/wp-json\/wp\/v2\/posts\/4905\/revisions"}],"predecessor-version":[{"id":4906,"href":"https:\/\/www.novonon.com\/blog\/wp-json\/wp\/v2\/posts\/4905\/revisions\/4906"}],"wp:attachment":[{"href":"https:\/\/www.novonon.com\/blog\/wp-json\/wp\/v2\/media?parent=4905"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.novonon.com\/blog\/wp-json\/wp\/v2\/categories?post=4905"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.novonon.com\/blog\/wp-json\/wp\/v2\/tags?post=4905"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}