Talk:Citoid/2024

Previous archives are at /Archive 1

Translator on Wikipedia

Hi, I'm not really familiar with how this works, sorry if this is the wrong place to post.

Last year I had a translator pushed to master on the zotero translator github repo, but Wikipedia is yet to incorporate it, which has been kinda annoying for me since I use the source a lot.

It's this one. Do you know who I should ask or how to make sure it gets activated? Renamed user 1oj3saabam (talk) 05:43, 3 February 2024 (UTC)

Hmm, I'm sorry about that.

We initially pulled in that translator by commit ea95b99d in September 2023, but our Zotero translator snapshot was from August 2023; we only synchronised the translators into the main service in February, and when trying to deploy them to production earlier this month, found that there was a big spike in errors, so we rolled back (T361728).

I'll ask there if there's further knowledge about the issue and if it's expected to roll forwards again. Jdforrester (WMF) (talk) 13:01, 30 April 2024 (UTC)

QID citations

The QID citations are provided by Zotero too? I wonder, why this works on mediawiki integration, but it does´t work on Zotero desktop. Is there somewhere publically available the script which handles this? Juandev (talk) 19:58, 15 February 2024 (UTC)

Citoid converts QIDs to wikidata urls and hands the url to Zotero. It will work in Zotero too if you give it the full url, not just the QID. Mvolz (WMF) (talk) 11:21, 16 February 2024 (UTC)

Well, the idea is where to place that url in Zotero desktop (My Library), because if I add that via Add Item by Identifier it ends with an error ("Zotero could not find any identifiers in your input. Please verify your input and try again.") And I dont see there any other area, this could be added. So my itentsions are to create a Zotero plugin, which would let the userts to upload citation to Zotero desktop via QID and potetionally also improve Wikidata iteam in the future, by sharing their Zotero improvments. So thats why I was interested, why it works for Citoid, but doesnt work for Zotero desktop. Juandev (talk) 09:24, 17 February 2024 (UTC)

Well I have tried to navigate the browser to a certain item in Wikidata and grap the page via Zotero connection, and it looks like, I have created something, but saying something, because its way from the expected behaviour. Namely it manages the resourse as a web page, doesnt grap the author mentioned in the item. So I assume that is more like scrap some metadate from the website rather then mapping the item itself. Juandev (talk) 20:01, 18 February 2024 (UTC)

VisualEditor's "convert" button uses Citoid to damage citations

This thread on en.wp is the story of a 70k+ editcount editor hitting "convert" over and over in VisualEditor and causing the loss of information from existing citations. Plenty of diffs in the thread. I don't know whether this problem comes from Citoid's output or from VisualEditor not checking existing template parameters to ensure it's not deleting anything, so crossposting to both talkpages. Folly Mox (talk) 11:25, 14 May 2024 (UTC)

Update since the thread linked above has been archived. I haven't duplicated the problem yet, but I'll try to put together some test cases and see what is happening exactly so I can file a phab ticket. Folly Mox (talk) 22:04, 18 May 2024 (UTC)

This flaw is heartbreaking. An article I created was impacted by this: a user used the "Convert" button in visual editor, and they thought they were "improving" the article ... and the edit convinced them it was better (citation in footnote looked cleaner). The user did not realize that the Citoid script was deleting some information from the citation!!!! (usually author name, publication date, publisher name, ... but also other data).

My article lost data from about five citations (about 1/3 of those that Convert script was applied to). But the user that used Convert script has done over 50,000 edits with that tool (I think that # is correct, I have not confirmed it). Does that mean that perhaps 10,000 citations have had data deleted?

This needs to be addressed ASAP !! [Signed user Noleander, cannot get signature to work here] Noleander (talk) 14:10, 14 May 2024 (UTC)

Missing

T362379

Hi, first, thank you for all the hard work you guys do on this tool. :)

Second, I've often wanted to cite papers on SSRN on Wikipedia, but citoid doesn't seem to work with SSRN. Is there any possibility of handling it? Thanks! Closed Limelike Curves (talk) 18:32, 30 August 2024 (UTC)

Hello, I've looked into this and it appears we're getting 429 too many requests errors for this website, which suggests we've been blocked by them. (From a different IP and user-agent, it works.) Unfortunately the solution to this may be we have to contact them individually... there's a long list of sites queued above this one, unfortunately!

In the interrum, I suggest using the doi as we can use crossRef for dois. (I know it is a pain!) There's also some lag for newer papers (i.e. 10.2139/ssrn.4012911 works but 10.2139/ssrn.5031806 is too new) Mvolz (WMF) (talk) 11:10, 4 December 2024 (UTC)

No worries, thanks!

If this is common, maybe it would be possible to run citoid locally? (i.e. my computer sends the request to SSRN and formats the citation, so there's no WMF IP in the middle to get blocked.) It looks like there's no issues if I use the Zotero extension to create a citation directly. I know basically nothing about web stuff, though, so I assume there's a good reason you guys don't/can't do that. Closed Limelike Curves (talk) 21:07, 4 December 2024 (UTC)

I've linked a task in the summary... but yeah, there are privacy implications around basically running code in the user's browser and getting data from their other open tabs, so it's a non starter I think. You can run Zotero locally, and Zotero can produce Wikipedia style citation templates. Extra steps! https://en.wikipedia.org/wiki/Wikipedia:Citing_sources_with_Zotero Mvolz (WMF) (talk) 11:47, 5 December 2024 (UTC)

UTF-8

Citoid is usually pretty good about UTF-8 conversion, but http://w.genealogy.euweb.cz/hung/batth3.html has the á come back as �. ~ AManWithNoPlan (talk) 13:19, 24 September 2024 (UTC)

When I request http://w.genealogy.euweb.cz/hung/batth3.html in my browser the content comes back encoded as non-UTF-8 (perhaps Windows-1252?), e.g. <TITLE>Batthy�ny 3</TITLE>. I think your browser is doing some magic to turn it into readable text, but I think the issue is in the source? Jdforrester (WMF) (talk) 18:24, 7 October 2024 (UTC)

Playing around with the encoding in Safari, I found that the "Default" option looks great, but UTF-8 is wrong. I went through some options and ISO Latin is what it is. Chrome and Safari on MacOS are both smart enough (perhaps same OS library), to figure out that it is not UTF-8. Character set guessing is not an exact science sadly (harder than NP-complete, blah blah blah), but heuristic guesses are usually pretty good. AManWithNoPlan (talk) 14:12, 8 October 2024 (UTC)