headers
Gregor Martynus | 2 Jul 2012 19:36
Gravatar

custom SQL dump?

Sorry if this is the wrong place to ask, please let me know if there is a better place or if you know somebody whom I could contact.

2 questions:

1. If I'd prepare 3 SQL SELECT queries to run against DEWIKI, could anybody with access actually run them and send me the results as sql dumps?
2. Could I have an SQL dump of http://simple.wikipedia.org/ or another small Wikipedia to prepare the queries?

The results will be ~20MB.

I was able – with the help of this mailing list – to extract the needed information out of the XML dumps last month, but it took me days to download and process the files and my friend will need the data another 3 - 4 times for her study. 

I'd really appreciate your help 

-- 
Gregor

<div>
<div>
                    Sorry if this is the wrong place to ask, please let me know if there is a better place or if you know somebody whom I could contact.
                </div>
<div><br></div>
<div>2 questions:</div>
<div><br></div>
<div>1. If I'd prepare 3 SQL SELECT queries to run against DEWIKI, could anybody with access actually run them and send me the results as sql dumps?</div>
<div>2. Could I have an SQL dump of&nbsp;http://simple.wikipedia.org/ or another small Wikipedia to prepare the queries?</div>
<div><br></div>
<div>The results will be ~20MB.</div>
<div><br></div>
<div>I was able &ndash; with the help of this mailing list &ndash; to extract the needed information out of the XML dumps last month, but it took me days to download and process the files and my friend will need the data another 3 - 4 times for her study.&nbsp;</div>
<div><br></div>
<div>I'd really appreciate your help&nbsp;</div>
                <div>
<div><br></div>
<div>--&nbsp;</div>
<div>Gregor<br>
</div>
<div><br></div>
</div>
</div>
Permalink | Reply |
headers
Napolitano, Diane | 2 Jul 2012 19:40
Favicon
Gravatar

Re: custom SQL dump?

Hi Gregor, if you need a SQL database of a Wikipedia dump up and running pretty fast (especially since you’ll be working with a small-ish dump, as opposed to, say, all of enwiki), you might find JWPL (http://code.google.com/p/jwpl/) to be useful.

 

No, I don’t contribute to that project…aside from bug reports. J

 

- Diane

 

From: xmldatadumps-l-bounces <at> lists.wikimedia.org [mailto:xmldatadumps-l-bounces <at> lists.wikimedia.org] On Behalf Of Gregor Martynus
Sent: Monday, July 02, 2012 1:37 PM
To: Wikipedia Xmldatadumps-l
Subject: [Xmldatadumps-l] custom SQL dump?

 

Sorry if this is the wrong place to ask, please let me know if there is a better place or if you know somebody whom I could contact.

 

2 questions:

 

1. If I'd prepare 3 SQL SELECT queries to run against DEWIKI, could anybody with access actually run them and send me the results as sql dumps?

2. Could I have an SQL dump of http://simple.wikipedia.org/ or another small Wikipedia to prepare the queries?

 

The results will be ~20MB.

 

I was able – with the help of this mailing list – to extract the needed information out of the XML dumps last month, but it took me days to download and process the files and my friend will need the data another 3 - 4 times for her study. 

 

I'd really appreciate your help 

 

-- 

Gregor

 

<div><div class="WordSection1">
<p class="MsoNormal"><span>Hi Gregor, if you need a SQL database of a Wikipedia dump up and running pretty fast (especially since you&rsquo;ll be working with a small-ish dump, as opposed to, say, all of enwiki), you might find JWPL (<a href="http://code.google.com/p/jwpl/">http://code.google.com/p/jwpl/</a>) to be useful.<p></p></span></p>
<p class="MsoNormal"><span><p>&nbsp;</p></span></p>
<p class="MsoNormal"><span>No, I don&rsquo;t contribute to that project&hellip;aside from bug reports. </span><span>J</span><span><p></p></span></p>
<p class="MsoNormal"><span><p>&nbsp;</p></span></p>
<p class="MsoNormal"><span>- Diane<p></p></span></p>
<p class="MsoNormal"><span><p>&nbsp;</p></span></p>
<div><p class="MsoNormal"><span>From:</span><span> xmldatadumps-l-bounces <at> lists.wikimedia.org [mailto:xmldatadumps-l-bounces <at> lists.wikimedia.org] On Behalf Of Gregor Martynus<br>Sent: Monday, July 02, 2012 1:37 PM<br>To: Wikipedia Xmldatadumps-l<br>Subject: [Xmldatadumps-l] custom SQL dump?<p></p></span></p></div>
<p class="MsoNormal"><p>&nbsp;</p></p>
<div><p class="MsoNormal">Sorry if this is the wrong place to ask, please let me know if there is a better place or if you know somebody whom I could contact. <p></p></p></div>
<div><p class="MsoNormal"><p>&nbsp;</p></p></div>
<div><p class="MsoNormal">2 questions:<p></p></p></div>
<div><p class="MsoNormal"><p>&nbsp;</p></p></div>
<div><p class="MsoNormal">1. If I'd prepare 3 SQL SELECT queries to run against DEWIKI, could anybody with access actually run them and send me the results as sql dumps?<p></p></p></div>
<div><p class="MsoNormal">2. Could I have an SQL dump of&nbsp;http://simple.wikipedia.org/ or another small Wikipedia to prepare the queries?<p></p></p></div>
<div><p class="MsoNormal"><p>&nbsp;</p></p></div>
<div><p class="MsoNormal">The results will be ~20MB.<p></p></p></div>
<div><p class="MsoNormal"><p>&nbsp;</p></p></div>
<div><p class="MsoNormal">I was able &ndash; with the help of this mailing list &ndash; to extract the needed information out of the XML dumps last month, but it took me days to download and process the files and my friend will need the data another 3 - 4 times for her study.&nbsp;<p></p></p></div>
<div><p class="MsoNormal"><p>&nbsp;</p></p></div>
<div><p class="MsoNormal">I'd really appreciate your help&nbsp;<p></p></p></div>
<div>
<div><p class="MsoNormal"><p>&nbsp;</p></p></div>
<div><p class="MsoNormal">--&nbsp;<p></p></p></div>
<div><p class="MsoNormal">Gregor<p></p></p></div>
<div><p class="MsoNormal"><p>&nbsp;</p></p></div>
</div>
</div></div>
Permalink | Reply |
headers
Jeremy Baron | 2 Jul 2012 19:45
Gravatar

Re: custom SQL dump?

On Mon, Jul 2, 2012 at 1:36 PM, Gregor Martynus <gregor@...> wrote:
> 1. If I'd prepare 3 SQL SELECT queries to run against DEWIKI, could anybody
> with access actually run them and send me the results as sql dumps?

You could try https://wiki.toolserver.org/view/Query_service

-Jeremy
Permalink | Reply |
headers
Gregor Martynus | 2 Jul 2012 19:49
Gravatar

Re: custom SQL dump?

Thanks Jeremy, I'll try that!

And thanks Diane, looks useful, cheers!

-- 
Gregor Martynus

On Monday, 2. July 2012 at 19:45, Jeremy Baron wrote:

On Mon, Jul 2, 2012 at 1:36 PM, Gregor Martynus <gregor <at> martynus.net> wrote:
1. If I'd prepare 3 SQL SELECT queries to run against DEWIKI, could anybody
with access actually run them and send me the results as sql dumps?


-Jeremy
 

<div>
<div>Thanks Jeremy, I'll try that!<div><br></div>
<div>And thanks Diane, looks useful, cheers!</div>
</div>
                <div>
<div><br></div>
<div>--&nbsp;</div>
<div>Gregor Martynus<br>
</div>
<div><br></div>
</div>

                <p>On Monday, 2. July 2012 at 19:45, Jeremy Baron wrote:</p>
                <blockquote type="cite">
                    <span><div><div>
<div>On Mon, Jul 2, 2012 at 1:36 PM, Gregor Martynus &lt;<a href="mailto:gregor <at> martynus.net">gregor <at> martynus.net</a>&gt; wrote:</div>
<blockquote type="cite"><div>
<div>1. If I'd prepare 3 SQL SELECT queries to run against DEWIKI, could anybody</div>
<div>with access actually run them and send me the results as sql dumps?</div>
</div></blockquote>
<div><br></div>
<div>You could try <a href="https://wiki.toolserver.org/view/Query_service">https://wiki.toolserver.org/view/Query_service</a>
</div>
<div><br></div>
<div>-Jeremy</div>
</div></div></span>

                 

                 
                </blockquote>

                <div>
                    <br>
</div>
</div>
Permalink | Reply |
headers
Gregor Martynus | 2 Jul 2012 21:11
Gravatar

Re: custom SQL dump?

I've created a ticket on Wikimedia's Query service:

Thanks!

-- 
Gregor Martynus

On Monday, 2. July 2012 at 19:49, Gregor Martynus wrote:

Thanks Jeremy, I'll try that!

And thanks Diane, looks useful, cheers!

-- 
Gregor Martynus

On Monday, 2. July 2012 at 19:45, Jeremy Baron wrote:

On Mon, Jul 2, 2012 at 1:36 PM, Gregor Martynus <gregor <at> martynus.net> wrote:
1. If I'd prepare 3 SQL SELECT queries to run against DEWIKI, could anybody
with access actually run them and send me the results as sql dumps?


-Jeremy
 


<div>
<div>I've created a ticket on Wikimedia's Query service:<div><a href="https://jira.toolserver.org/browse/DBQ-189">https://jira.toolserver.org/browse/DBQ-189</a></div>
<div><br></div>
<div>Thanks!</div>
</div>
                <div>
<div><br></div>
<div>--&nbsp;</div>
<div>Gregor Martynus<br>
</div>
<div><br></div>
</div>

                <p>On Monday, 2. July 2012 at 19:49, Gregor Martynus wrote:</p>
                <blockquote type="cite">
                    <span><div><div>
                <div>Thanks Jeremy, I'll try that!<div><br></div>
<div>And thanks Diane, looks useful, cheers!</div>
</div>
                <div>
<div><br></div>
<div>--&nbsp;</div>
<div>Gregor Martynus<br>
</div>
<div><br></div>
</div>

                <p>On Monday, 2. July 2012 at 19:45, Jeremy Baron wrote:</p>
<blockquote type="cite"><div>
                    <span><div><div>
<div>On Mon, Jul 2, 2012 at 1:36 PM, Gregor Martynus &lt;<a href="mailto:gregor <at> martynus.net">gregor <at> martynus.net</a>&gt; wrote:</div>
<blockquote type="cite"><div>
<div>1. If I'd prepare 3 SQL SELECT queries to run against DEWIKI, could anybody</div>
<div>with access actually run them and send me the results as sql dumps?</div>
</div></blockquote>
<div><br></div>
<div>You could try <a href="https://wiki.toolserver.org/view/Query_service">https://wiki.toolserver.org/view/Query_service</a>
</div>
<div><br></div>
<div>-Jeremy</div>
</div></div></span>

                  

                  
                </div></blockquote>
<div>
                    <br>
</div>
            </div></div></span>

                 

                 
                </blockquote>

                <div>
                    <br>
</div>
</div>
Permalink | Reply |

Gmane