Forum Overview :: We Love Katamari
 
Stack Overflow is also shutting down their data sharing program by blackwater 06/09/2023, 5:27pm PDT
The free lunch is over


DISCLAIMER: I was recently impacted by the Company's layoff. I am going to carefully respond in a way that ensures I don't reveal anything the Company may feel is confidential--particularly with regard to strategy, or future plans. Any knowledge I have on strategy or future plans is both dated and confidential, and thus it would be irresponsible for me to say more. As a result, this answer may feel incomplete. I suspect that the CM team is rather busy this week with other topics. I'm offering what I can to uphold the Company's values of Transparency & being Community-centric.

The upload to the Internet Archive has been disabled.
The job that uploads the data dump to Archive.org was disabled on 28 March, and marked to not be re-enabled without approval of senior leadership. Had it run as scheduled, it would have completed on the first Monday after the first Sunday in June.

I mention the timing, as this change long pre-dated the current moderator strike and related policy changes. Some comments have suggested otherwise, so I thought it an important detail.

Is it going to stay that way?
Hopefully the Company will provide an answer that includes this.

Edit: The following is an excerpt from a different answer provided by Jody Bailey, CTO of Stack Overflow:


We are looking for ways to gate access to the Dump, APIs, and SEDE, that will allow individuals access to the data while preventing misuse by organizations looking to profit from the work of our community. We are working to design and implement appropriate safeguards and still sorting out the details and timelines. We will provide regular updates on our progress to this group.


How can I access that data?
Stack Exchange Data Explorer (aka SEDE) contains a subset of all data for all sites, with PII removed. The same data available in the data dump is also available on SEDE.

SEDE is updated via a weekly full refresh (every weekend). The Data Dump that is uploaded to Archive.org is a dump of the SEDE databases. The weekly SEDE refresh runs, then the data is dumped to XML & 7zipped, then the 7z files are uploaded to the Archive.

SEDE can't address all the use cases of the Data Dump, nor vice versa. However, there is overlap, and the data is at least queryable.
PREVIOUS NEXT REPLY QUOTE
 
"So, $20 million a year should do it," we said seriously by Ownership at Reddit 05/31/2023, 9:31pm PDT NEW
    Redditors react to a Blue Jays pitcher entering the game by You can't make this up 05/31/2023, 9:36pm PDT NEW
        "That's it, he's a conservative." by pinback 06/04/2023, 11:07am PDT NEW
            Re: "That's it, he's a conservative." by You can't make this up 06/05/2023, 12:15pm PDT NEW
                That's still just one thing. NT by Michael Drop, PhD 06/05/2023, 3:19pm PDT NEW
    I hate Reddit as much as the next man, BUT sharing data was a ZIRP phenomenon by blackwater 06/05/2023, 2:49pm PDT NEW
    Stack Overflow is also shutting down their data sharing program by blackwater 06/09/2023, 5:27pm PDT NEW
    Re: "So, $20 million a year should do it," we said seriously by Mysterio 06/09/2023, 8:38pm PDT NEW
    "YOU broke Reddit!" by HURRRRRRR 06/12/2023, 9:57am PDT NEW
        No diaper's gonna hold in that hole NT by MAID audit 06/12/2023, 10:01am PDT NEW
        Yes, you. The overweight guy with the neckbeard. by blackwater 06/12/2023, 1:27pm PDT NEW
        Reddit is clown by David Linch 06/12/2023, 3:04pm PDT NEW
    spez being a lying shit and the Apollo guy recording the call was hilarious NT by Feris 06/13/2023, 11:51am PDT NEW
    5 captcha shits to register in hfboards tonight by Jack Bauer 06/13/2023, 9:44pm PDT NEW
    Re: "So, $20 million a year should do it," we said seriously by MM 06/14/2023, 5:56am PDT NEW
        Is this Trantifa NT by Tranpa 06/14/2023, 5:04pm PDT NEW
    Reddit blackout protest to continue indefinitely, moderators say by blackwater 06/15/2023, 9:39am PDT NEW
        Everyone involved in this Reddit this is ASSSSSSSSSSSSSSSSSSSSS by Mysterio 06/15/2023, 3:47pm PDT NEW
            Re: Everyone involved in this Reddit this is ASSSSSSSSSSSSSSSSSSSSS by Mysterio 06/15/2023, 4:58pm PDT NEW
                Re: Everyone involved in this Reddit this is ASSSSSSSSSSSSSSSSSSSSS by Shit Spez Sez 06/16/2023, 10:42am PDT NEW
                    I hope the protesting mods all get banned and the site implodes by blackwater 06/16/2023, 1:26pm PDT NEW
                        great, we got it NT by laudablepuss 06/16/2023, 2:49pm PDT NEW
        NBA mods give up like the cowards they are. by Kirahu Nagasawa 06/17/2023, 8:15pm PDT NEW
            The best part by Kirahu Nagasawa 06/17/2023, 8:24pm PDT NEW
    Steve Huffman being a pathetic piece of shit by Kirahu Nagasawa 06/19/2023, 10:14am PDT NEW
        I enjoyed the "landed gentry" comment by blackwater 06/19/2023, 11:49pm PDT NEW
    Mojang leaves reddit by laudablepuss 06/27/2023, 6:54pm PDT NEW
    Is this over? It feels like it's over. by blackwater 06/30/2023, 12:34pm PDT NEW
    Tom Scott on Redditors is the most accurate document on the internet. by Mysterio 01/01/2024, 6:18pm PST NEW
        It's kind of hard to have sympathy for someone who wants to be an e-celebrity by blackwater 01/02/2024, 3:33pm PST NEW
            It's kind of hard to have sympathy for someone who wants to be an e-celebrity by Mysterio 01/02/2024, 5:39pm PST NEW
    Their worthless CEO was paid around $193 million dollars. I forget the exact by amount 02/23/2024, 9:57pm PST NEW
    Reddit will start pay walling subreddits by Caltrops will always be free! 08/11/2024, 5:57am PDT NEW
 
powered by pointy