Jump to content

Talk:Offline content generator

Add topic
From mediawiki.org


Outcome?

[edit]

The following discussion is closed. Please do not modify it. Subsequent comments should be made on the appropriate discussion page. No further edits should be made to this discussion.


What was the final result here? Sumana Harihareswara, Engineering Community Manager (talk) 16:23, 3 January 2014 (UTC)Reply

The first sprint resulted in code, and there's a second 2-week (I think) sprint starting today to try to get it deployed. Anomie (talk) 15:01, 6 January 2014 (UTC)Reply
Correct; 2nd sprint is from January 6 and end on January 17 (according to ops ml). AKlapper (WMF) (talk) 15:25, 6 January 2014 (UTC)Reply
The discussion above is closed. Please do not modify it. No further edits should be made to this discussion.

Test instance and bug triage

[edit]

The following discussion is closed. Please do not modify it. Subsequent comments should be made on the appropriate discussion page. No further edits should be made to this discussion.


What's the URL of the current test instance? Both [1] and [2] are offline. I'd like to organise a Wikibooks/Wikisource bug day to retest old mwlib bugs from http://web.archive.org/web/20111201152942/http://code.pediapress.com/wiki/report/1 but I don't know where. In the meanwhile I pasted a list at [etherpad:BugTriage-mwlib etherpad:BugTriage-mwlib]. Nemo 11:56, 24 April 2014 (UTC)Reply

I'll have to set a server back up again -- I failed to move the server during the labs migration. It's on my list of things to do (very high up); there's just been a boatload of fundraising duties getting in the way. I think this week those've settled. My goal has this done by tomorrow in beta labs; and if not then, by the end of the week. Mwalker (WMF) (talk) 18:57, 28 April 2014 (UTC)Reply
Thank you very much for the answer. Let us know here when it's ready for testing. :) Nemo 09:47, 29 April 2014 (UTC)Reply
Nemo, I'm an idiot... It took me till today to setup a wmlib server in labs; only to realize I didn't actually need one. Production PDF rendering is available from labs... (So use en.wikipedia.beta.wmflabs.org or an equivalent.) I'm blocked on offering the new renderer for testing in labs because I don't have an Ubuntu 14.04 image (and there's other deployment troubles I'm fighting.)
Basically; you can test collection / mwlib to your hearts content right now anywhere in betalabs. I'll have to get back to you when I have everything setup for the new renderer. Mwalker (WMF) (talk) 21:16, 5 May 2014 (UTC)Reply
Ouch, sorry for the confusion. I mentioned the known mwlib bugs, but I want to test them against the new PDF renderer (I see this was only explicitly said in the etherpad but not in this thread).
It's useful to know that labs can be used to test mwlib, but I'll keep waiting for the new test instance. Nemo 10:01, 6 May 2014 (UTC)Reply
Nemo; I'm sorry it took this long -- but after a week and a half of fighting with deployments and ubuntu 14.04; the test rendering instance is up and running on beta labs. It's the WMF PDF option in Special:Collection and in the side pane. Mwalker (WMF) (talk) 00:54, 30 May 2014 (UTC)Reply
Wee. :) Now we only need a good content sample. Can we get a biggish Wikipedia and a Wikisource fully imported on some domain? Otherwise let's hope giving import rights to all willing testers works. :) Nemo 08:28, 30 May 2014 (UTC)Reply
Hello,
Current PDF rederer does not handle HTML5 tag like <time> or <data> so I hope this new one will come quickly.
I've tried to test it on en.wikipedia.beta.wmflabs.org (random page, tested several time), but
  • I don't see WMF PDF on Special:Book (= Special:Collection)
  • When I click on "Download as WMF PDF" in the side pane, I end-up on a "Book rendering failed" page, with the message "There was an error while attempting to render your book.
What am I doing wrong ? Zebulon84 (talk) 10:42, 8 June 2014 (UTC)Reply
Same here when trying a random article. Something must have happened last week, it used to work. Nemo 15:51, 8 June 2014 (UTC)Reply
Pages on http://en.wikipedia.beta.wmflabs.org/ offer "Print/export > Download as WMF PDF" for me, but would be awesome to also test this on complex and RTL pages... AKlapper (WMF) (talk) 14:55, 9 June 2014 (UTC)Reply
I accidentally broke the renderer last week by applying a faulty firewall rule and then not having enough time to test it... I fixed that last night. Mwalker (WMF) (talk) 16:47, 9 June 2014 (UTC)Reply
That works better, thanks.
The HTML 5 tags are correctly printed.
But it seams tables are not on the pdf.
Tested on this page, mix of real French Wikipedia content and some simple exemples.
Also noticed these minor issues :
  • Generated pdf do not have a .pdf extension, so firefox offer me to download it instead of displaying it as pdf.
  • The name in the collection tool seams to be <coll-format-rdf2latex>, with is not user friendly. Zebulon84 (talk) 20:27, 12 June 2014 (UTC)Reply
I went through all bugs in [etherpad:BugTriage-mwlib etherpad:BugTriage-mwlib]. About half were triaged or postponed, on the other half I'd use help because they're harder to assess or testing is currently blocked on other bugs. Time for a bug day for real now, I guess. Nemo 23:44, 25 September 2014 (UTC)Reply
I've created Bug management/Triage/201410, please signup and remove dates which are not ok for you. Nemo 13:04, 26 September 2014 (UTC)Reply
The date was set (2014-10-08) and announced to 10 mailing lists and 54 talk pages. Nemo 18:19, 29 September 2014 (UTC)Reply
The discussion above is closed. Please do not modify it. No further edits should be made to this discussion.

Testinstance

[edit]

The following discussion is closed. Please do not modify it. Subsequent comments should be made on the appropriate discussion page. No further edits should be made to this discussion.


The labs test-instance seems to be down. Physikerwelt (talk) 12:24, 19 August 2014 (UTC)Reply

Production seems to work, though. Please test. ;-) https://etherpad.wikimedia.org/p/BugTriage-mwlib Nemo 09:53, 21 August 2014 (UTC)Reply
The discussion above is closed. Please do not modify it. No further edits should be made to this discussion.

Tables

[edit]

The page has no mention of the fact that tables are unsupported. Is there any page where the topic is covered? Information on the new PDF rendering is scattered all over the place so I don't know if this is the best page still.

In any case, here are some things to watch for when adding tables support (taken from the mwlib tracker):

Stay Fetching

[edit]

Hi. I installed the OCG bundle, and configurate my wiki, When I try to use it, the mw-ocg-service.js server fetching stays for a while and ends saying: "Status: Bundling process died with non zero code: 1" The process is the next:

first it says:

Progress: 0 % Status: Fetching wiki configuration (wiki page: http://my.domain.org) After few seconds:

Progress: 2.5 % Status: Fetching wiki configuration (wiki page: https://commons.wikimedia.org/w ) and there it stays for a while...

After several minutes say:

Generation of the document file has failed.

Status: Bundling process died with non zero code: 1

What's going on?

Maybe it has releated with the need of using proxy to connect to external sites. What it is not supposed that the server should not use anything outside (OFFLINE Content Generator)?

What I'm doing wrong?

Excuse my bad grammar. AvisPhoenix (talk) 22:53, 20 August 2015 (UTC)Reply

Does your wiki use Manual:$wgUseInstantCommons ? It seems like the fetch is failing when trying to connect to commons. If you don't use instant commons, it shouldn't be trying to connect.
(The "OFFLINE" refers to the *result*, not the *process*.) cscott (talk) 15:25, 19 April 2016 (UTC)Reply

Any plans on fluffing up installation instructions?

[edit]

The following discussion is closed. Please do not modify it. Subsequent comments should be made on the appropriate discussion page. No further edits should be made to this discussion.


It looks like this is the way to go. These instructions however fail as cheerful as these on a debian 8. I am a bit lost? Example when trying to run ./mw-ocg-service.js -c localsettings.js :

/.../w/extensions/Collection/OfflineContentGenerator/lib/cli.js:33
		config = require(configFile)(config) || config;
		                            ^
TypeError: object is not a function
    at Object.exports.parseConfig (/.../w/extensions/Collection/OfflineContentGenerator/lib/cli.js:33:31)
    at Object.<anonymous> (/.../w/extensions/Collection/OfflineContentGenerator/mw-ocg-service.js:46:18)
    at Module._compile (module.js:456:26)
    at Object.Module._extensions..js (module.js:474:10)
    at Module.load (module.js:356:32)
    at Function.Module._load (module.js:312:12)
    at Function.Module.runMain (module.js:497:10)
    at startup (node.js:119:16)
    at node.js:906:3

I guess it will be nice to use this instead of mwlib since I believe that a lot of effort has been put into this software.

I have added a more verbose version on how I got here at this spot. [[kgh]] (talk) 22:44, 16 March 2016 (UTC)Reply

Could you paste the contents of your localsettings.js? Something is probably wrong there. cscott (talk) 15:24, 19 April 2016 (UTC)Reply
I really should refrain from cross-posting and it probably was the result of this utter disappointment I encountered when trying to follow the current instructions. I figured to install OCG should not be worse to achieve that mwlib but the opposite seems to be the case. This post is basically about getting some human readable instructions. To cut it short, I answered on the linked thread. [[kgh]] (talk) 08:07, 21 April 2016 (UTC)Reply
Ok, I will respond at the other thread. cscott (talk) 17:15, 29 April 2016 (UTC)Reply
The discussion above is closed. Please do not modify it. No further edits should be made to this discussion.