Talk:Quarry

Previous discussion was archived at Talk:Quarry/Archive 1 on 2015-04-17. Discussion area for discussion about Quarry itself and help about individual queries.

"cross wiki" joins are no longer possible due to technical changes that we have been forced to make on the backing wiki replica database servers. See wikitech:News/Wiki Replicas 2020 Redesign and phab:T260389 for more detailed information.

@Matěj Suchánek: could you please look on this, wikidatawiki_p.* are not working, Thanks!

wikidatawiki_p is a database name. This query is attempting a "cross wiki join" which is no longer possible due to technical changes that we have been forced to make on the backing wiki replica database servers. See wikitech:News/Wiki Replicas 2020 Redesign and phab:T260389 for more detailed information.

Thanks for your info. Could someone rewrite the quarry, so it can be queried.

No, it isn't possible to do this kind of query using Quarry anymore.

Thank you for response.

Solved

Anyone working on this?

Goodbye USE databasename; and hello typing databasename in the box above the word "SQL".

So, if you have any old queries, then before running them again, you should remove the "USE" statement at the top and instead type in the database name in the box above the word "SQL".

Is the box going to have a text next to it saying that it's for the database name? Also, nothing currently happens when I click 'Submit'.

Let me say that this is absolute bullsh** now, no matter which DB Name I enter ...nothing happens..query never gets executed.

There are reports of some problems, please be patient or share yours there.

Hi, I need to retrieve all unreviewed pages (like https://uk.wikipedia.org/wiki/Special:UnreviewedPages ) and can't find the way how to do that. Does anyone know?

Just realized - https://quarry.wmflabs.org/query/53308 need to search for "fp_reviewed is null".

But if someone knows a faster query - please tell me.

You can probably optimize using actor_revision view.

Hi, is it possible to search for all public quarries? Right now we can only browse the most recent ones. Is it not available by design or for some other reasons? TY.

oh, nvm, I found it here https://www.google.com/search?q=site%3Aquarry.wmflabs.org via https://meta.wikimedia.org/wiki/Research:Quarry

Hello,

I wonder if my research is possible.

I'm just trying to get a list of the names of all the 'new' persons that have been entered in wiki in the last two months (so I should find there Stella Morris, George Floyd, Derek Chauvin etc... and a lot of people who were unknown 2 months ago).

I suppose I should adapt this query but I don't know how.

Thanks for your help if you can

USE wikidatawiki_p;

SELECT rev_id AS first_edit FROM revision WHERE rev_timestamp BETWEEN "20200501" AND "20200624" ORDER BY RAND() LIMIT 5000;

User account creation log is stored on logging table. Try this query!

quarry.wmflabs.org/query/53090

Where can I see the comment_id of the deleted edits of a page? At the time deletion, when the rows are moved from Revision table to Archive table, I thought, the rev_comment_id is moved to ar_comment_id. But the comment_id of the Archive table (in tewiki_p) is showing null for all the rows. Can somebody help me where I can find the comment_id

Isn't that on purpose, so that deleted stuff is hidden from ordinary users?

Got it. Thank you

Hey there. I'm trying to run a query to grab all usernames with 10,000+ edits on en-wiki. But it's only returning random small numbers of users (like 50-200 each time). Any tips? Thanks.

SELECT user_name, user_editcount

FROM user

WHERE user_editcount >= 10000

ORDER BY user_editcount DESC;

In 94 seconds, it returns 10,002 results for me. Maybe you are not querying enwiki (USE enwiki_p)?

User:Matěj Suchánek, thanks for the reply. The query worked for me about 15 minutes after I posted this, without modifications. It appears to have been a random glitch in the system. Thanks for your help.

Hi

https://quarry.wmflabs.org/query/50304 does not start at all (since a few days). Before that ( made some change) it ran and produced sound results without any timeout. See similar https://quarry.wmflabs.org/query/50070 , whích ran and where the result is still in the cache.

There are two selects, running only the first will start and finish. Running only the second will not start. without any hint or error message, it just fails silently.

Can somebody help to find / fix the problem? best

Try https://quarry.wmflabs.org/query/50253 (quarries that are not executed are not safed, so https://quarry.wmflabs.org/query/50304 is empty). Was empty, I now played around a little bit and it seems that there is a size limitation for the sql script, / for each select statement.

got the following messages in the console:

/api/query/run:1 Failed to load resource: the server responded with a status of 500 ()
50304:1 Refused to load the image 'data:image/gif;base64,R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw==' because it violates the following Content Security Policy directive: "img-src 'self'".
/api/query/run:1 Failed to load resource: the server responded with a status of 500 ()
jquery.js:8623 POST https://quarry.wmflabs.org/api/query/run 500
send @ jquery.js:8623
ajax @ jquery.js:8152
n.<computed> @ jquery.js:8298
(anonymous) @ view.js:80
dispatch @ jquery.js:4409
r.handle @ jquery.js:4095

(its chrome)

message for status 500 is:

500 Internal Error

Sadly Quarry is currently experiencing issues and is unavailable. Please try again later.

But I have to dig into the browser debugger to see this. No message on the UI.

Hi @Herzi Pinki:, could you re-try now? If it's working, it was probably a temporary issue.

Thanks, it is working now.

For a temporary issue it took quite long to fix it. It would be an improvement, if a status of 500 is propagated to the UI anyway.

A while ago there was an issue with Excel XLSX download format, which was fixed by cleaning some temp files from somewhere. It seems to be happening again and an attempt to open generated spreadsheets gives invalid file format or extension error.

Hello Jarekt, can you confirm the problem was solved in the meantime ? Thanks!

yes it is solved

@Framawiki:, same problem is happening again

Facing the same problem since yesterday

Hi, thanks for the notification. We're facing issue (phab:T238375) where we've to manually fix when problem happens, until we found a workaround. So don't hesitate to ping again if you're facing the issue. Thanks!