Extension talk:Collection/2017

Change book look & feel

Is there's any way to change the design of the rendered pdf? i.e - add some css, fonts, etc.? Wess (talk) 21:47, 17 January 2017 (UTC)

Hi! Yeah! I planned to do that and obviously, to start making some kind of structure. Unfortunately I have had a lot of work and it couldn't have done. Would you like to join me and make a contribution or building this together? FerociouslyReligious (talk) 02:03, 31 January 2017 (UTC)

Hi. we have a project that is due in a month, so we're in to it. Lets talk and proceed somehow. Wess (talk) 15:19, 2 February 2017 (UTC)

Can this extension be deployed to zh.wikipedia?

see community consensus. 星耀晨曦 (talk) 10:41, 3 February 2017 (UTC)

Such requests are piped in via Phabricator. I suggest to create a task for this. [[kgh]] (talk) 12:17, 3 February 2017 (UTC)

How to get code review for this extension

How to get https://gerrit.wikimedia.org/r/#/c/336342/ merged? Are there any active maintainers of this extension? Is there any deployment step besides the merge in Gerrit itself? ~ Mutante (talk) 23:29, 13 February 2017 (UTC)

How to create collection_id from my article list

Hello guys, I would like to generate the collection_id from set of article and use this collection_id to create the pdf file from Wikipedia

Now 140.115.51.162 (talk) 06:17, 7 March 2017 (UTC)

Print/Export menu not showing on custom namespaces

Can't get the print/export menu in the sidebar to show up in custom namespaces. It shows everywhere else. Any ideas of how to fix this? 70.120.85.152 (talk) 01:59, 6 April 2017 (UTC)

I believe you will have to add this namespace to the $wgCollectionArticleNamespaces configuration parameter. [[kgh]] (talk) 06:03, 6 April 2017 (UTC)

Thanks. I had already done that but rechecked and had a typo. All good now. 70.120.85.152 (talk) 05:02, 8 April 2017 (UTC)

Getting error when using PdfBook on render server

Im using mediawiki 1.28 with the PdfBook and Collection. Im running 4.4.0-67-generic #88-Ubuntu SMP Installed the mw-render and used this tutorial: https://www.mediawiki.org/wiki/Setup_a_render_server_on_Ubuntu_12.04_LTS Following error after pdf-download action:

/***************************************** Startof log.txt *********************************************************/
/data/mwcache/log.txt                                                                                                                                                                                           179535/175K              100%
have 0 jobs
count: 18
all channels idle


error finish: bab34137f302840d:makezip: 'RuntimeError: command failed with returncode 256: [\'mw-zip\', \'-o\', \'/data/mwcache/ba/bab34137f302840d/collection.zip\', \'-m\', \'/data/mwcache/ba/bab34137f302840d/metabook.json\', \'--status
\', \'qserve://localhost:14311/bab34137f302840d:makezip\', \'--config\', \'https://wiki.senedo.de\', \'--username\', \'senedo\', \'--password\', \'{OMITTED}\']\nLast Output:\n    1%  creating nuwiki in u\'/data/mwcache/ba/bab34137f302840
d/tmpqb3ZCc/nuwiki\'\n    removing tmpdir u\'/data/mwcache/ba/bab34137f302840d/tmpqb3ZCc\'\n    memory used: res=17.1 virt=124.3\n    1% error Traceback (most recent call last):\n      File "/usr/local/bin/mw-zip", line 11, in <module>\n
        sys.exit(main())\n      File "/usr/local/lib/python2.7/dist-packages/mwlib/apps/buildzip.py", line 155, in main\n        make_zip(output, options, env.metabook, podclient=podclient, status=status)\n      File "/usr/local/lib/pyth
on2.7/dist-packages/mwlib/apps/buildzip.py", line 49, in make_zip\n        from mwlib.apps.make_nuwiki import make_nuwiki\n      File "/usr/local/lib/python2.7/dist-packages/gevent/builtins.py", line 93, in __import__\n        result = _
import(*args, **kwargs)\n      File "/usr/local/lib/python2.7/dist-packages/mwlib/apps/make_nuwiki.py", line 6, in <module>\n        from mwlib.net import fetch, sapi as mwapi\n      File "/usr/local/lib/python2.7/dist-packages/gevent/bu
iltins.py", line 93, in __import__\n        result = _import(*args, **kwargs)\n      File "/usr/local/lib/python2.7/dist-packages/mwlib/net/fetch.py", line 7, in <module>\n        import gevent, gevent.pool, gevent.coros, gevent.event\n
     File "/usr/local/lib/python2.7/dist-packages/gevent/builtins.py", line 93, in __import__\n        result = _import(*args, **kwargs)\n    ImportError: No module named coros\n     in function system, file /usr/local/lib/python2.7/dist
-packages/mwlib/nslave.py, line 64'
error finish: bab34137f302840d:render-rl: 'RuntimeError: RuntimeError: command failed with returncode 256: [\'mw-zip\', \'-o\', \'/data/mwcache/ba/bab34137f302840d/collection.zip\', \'-m\', \'/data/mwcache/ba/bab34137f302840d/metabook.js
on\', \'--status\', \'qserve://localhost:14311/bab34137f302840d:makezip\', \'--config\', \'https://wiki.senedo.de\', \'--username\', \'senedo\', \'--password\', \'{OMITTED}\']\nLast Output:\n    1%  creating nuwiki in u\'/data/mwcache/ba
/bab34137f302840d/tmpqb3ZCc/nuwiki\'\n    removing tmpdir u\'/data/mwcache/ba/bab34137f302840d/tmpqb3ZCc\'\n    memory used: res=17.1 virt=124.3\n    1% error Traceback (most recent call last):\n      File "/usr/local/bin/mw-zip", line 1
1, in <module>\n        sys.exit(main())\n      File "/usr/local/lib/python2.7/dist-packages/mwlib/apps/buildzip.py", line 155, in main\n        make_zip(output, options, env.metabook, podclient=podclient, status=status)\n      File "/us
r/local/lib/python2.7/dist-packages/mwlib/apps/buildzip.py", line 49, in make_zip\n        from mwlib.apps.make_nuwiki import make_nuwiki\n      File "/usr/local/lib/python2.7/dist-packages/gevent/builtins.py", line 93, in __import__\n
      result = _import(*args, **kwargs)\n      File "/usr/local/lib/python2.7/dist-packages/mwlib/apps/make_nuwiki.py", line 6, in <module>\n        from mwlib.net import fetch, sapi as mwapi\n      File "/usr/local/lib/python2.7/dist-Tr
aceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/qs/slave.py", line 150, in handle_one_job
    result = workhandler(qs).dispatch(job)
  File "/usr/local/lib/python2.7/dist-packages/qs/slave.py", line 50, in dispatch
    return m(**tmp)
  File "/usr/local/lib/python2.7/dist-packages/mwlib/nslave.py", line 171, in rpc_render
    return doit(**params)
  File "/usr/local/lib/python2.7/dist-packages/mwlib/nslave.py", line 158, in doit
    self.qaddw(channel="makezip", payload=dict(params=params), jobid="%s:makezip" % (collection_id, ), timeout=20 * 60)
  File "/usr/local/lib/python2.7/dist-packages/qs/slave.py", line 66, in qaddw
    raise RuntimeError(error)
RuntimeError: RuntimeError: command failed with returncode 256: ['mw-zip', '-o', '/data/mwcache/ba/bab34137f302840d/collection.zip', '-m', '/data/mwcache/ba/bab34137f302840d/metabook.json', '--status', 'qserve://localhost:14311/bab34137f
302840d:makezip', '--config', 'https://wiki.senedo.de', '--username', 'senedo', '--password', '{OMITTED}']
Last Output:
    1%  creating nuwiki in u'/data/mwcache/ba/bab34137f302840d/tmpqb3ZCc/nuwiki'
    removing tmpdir u'/data/mwcache/ba/bab34137f302840d/tmpqb3ZCc'
    memory used: res=17.1 virt=124.3
    1% error Traceback (most recent call last):
      File "/usr/local/bin/mw-zip", line 11, in <module>
        sys.exit(main())
      File "/usr/local/lib/python2.7/dist-packages/mwlib/apps/buildzip.py", line 155, in main
        make_zip(output, options, env.metabook, podclient=podclient, status=status)
      File "/usr/local/lib/python2.7/dist-packages/mwlib/apps/buildzip.py", line 49, in make_zip
        from mwlib.apps.make_nuwiki import make_nuwiki
      File "/usr/local/lib/python2.7/dist-packages/gevent/builtins.py", line 93, in __import__
        result = _import(*args, **kwargs)
      File "/usr/local/lib/python2.7/dist-packages/mwlib/apps/make_nuwiki.py", line 6, in <module>
        from mwlib.net import fetch, sapi as mwapi
      File "/usr/local/lib/python2.7/dist-packages/gevent/builtins.py", line 93, in __import__
        result = _import(*args, **kwargs)
      File "/usr/local/lib/python2.7/dist-packages/mwlib/net/fetch.py", line 7, in <module>
        import gevent, gevent.pool, gevent.coros, gevent.event
      File "/usr/local/lib/python2.7/dist-packages/gevent/builtins.py", line 93, in __import__
        result = _import(*args, **kwargs)
    ImportError: No module named coros
     in function system, file /usr/local/lib/python2.7/dist-packages/mwlib/nslave.py, line 64
127.0.0.1 - - [2017-04-12 13:25:52] "POST / HTTP/1.0" 200 2187 0.005049
127.0.0.1 - - [2017-04-12 13:25:53] "POST / HTTP/1.0" 200 2187 0.004951
/***************************************** End of log.txt *********************************************************/

88.74.203.177 (talk) 11:30, 12 April 2017 (UTC)

Hi, I have the same problem. Did you find any solution? 82.135.96.88 (talk) 12:40, 28 May 2017 (UTC)

It's a problem with gevent. Coros was deprecated and is now removed.

Downgrade to a previous version with

pip install gevent==1.0 217.17.16.146 (talk) 09:28, 31 May 2017 (UTC)

Thanks a lot, it seems to work now, at least for simple articles.

I had an older version of the render server running on Ubuntu 14.04 and it seemed to work better:

- The rendering page updated automatically. Now I have to reload the page manually.

- It seemed to work for more complex pages. Now I very often get the error "WARNING: Article could not be rendered - ouputting plain text.

Potential causes of the problem are: (a) a bug in the pdf-writer software (b) problematic Mediawiki markup (c) table

is too wide" 82.135.96.88 (talk) 19:25, 31 May 2017 (UTC)

Okay, I hacked Image.py of Pillow to make tostring available again. Now more pages can be rendered properly.

I wish the render server components would be upgraded as they seem to be quite outdated. 82.135.96.88 (talk) 20:28, 31 May 2017 (UTC)

I ran into the same problem. I found out that gevent.coros was renamed to gevent.lock. Therefore you could also update the code of mwlib by doing:

find . -type f -exec sed -i 's/coros/lock/g' {} \;

I also got the error KeyError: 'revisions', and solved it by replacing revs = e["revisions"] with revs = e.get("revisions","") in pp/local/lib/python2.7/site-packages/mwlib/net/sapi.py:311. ChristophJahn (talk) 08:39, 18 June 2017 (UTC)

Datei nicht gefunden Die Datei, die du versuchst herunterzuladen, ist nicht vorhanden: Möglicherweise wurde sie gelöscht oder sie muss neu generiert werden.

Running newest mwlib and collection... 92.214.160.71 (talk) 08:28, 18 April 2017 (UTC)

Not a reel fix but see: https://www.mediawiki.org/wiki/Extension%20talk%3ACollection/2014#h-The_file_you_are_trying_to_download_does_not_exist...-2014-02-04T08%3A37%3A00.000Z Felipe (talk) 13:41, 18 April 2017 (UTC)

urllib2 error when running your own rendering server

Getting the following error when running my own rendering server:

new-collection 1        'https://epss-dev-mw01.example.com/mediawiki'     'rl'

2017-10-20T08:12:31 mwlib.serve.info >> render 130c6a8548c2745b rl

10.102.177.204 - - [2017-10-20 08:12:31] "POST / HTTP/1.0" 200 200 0.004170

10.102.177.204 - - [2017-10-20 08:12:31] "POST / HTTP/1.0" 200 215 0.003583

10.102.177.204 - - [2017-10-20 08:12:32] "POST / HTTP/1.0" 200 229 0.002870

10.102.177.204 - - [2017-10-20 08:12:32] "POST / HTTP/1.0" 200 229 0.003326

10.102.177.204 - - [2017-10-20 08:12:33] "POST / HTTP/1.0" 200 229 0.003243

10.102.177.204 - - [2017-10-20 08:12:34] "POST / HTTP/1.0" 200 229 0.003381

10.102.177.204 - - [2017-10-20 08:12:34] "POST / HTTP/1.0" 200 229 0.002904

10.102.177.204 - - [2017-10-20 08:12:35] "POST / HTTP/1.0" 200 229 0.002736

10.102.177.204 - - [2017-10-20 08:12:36] "POST / HTTP/1.0" 200 229 0.002985

256 5.48739695549 ['mw-zip', '-o', '/root/cache/13/130c6a8548c2745b/collection.zip', '-m', '/root/cache/13/130c6a8548c2745b/metabook.json', '--status', 'qserve://localhost:14311/130c6a8548c2745b:makezip', '--config', 'https://epss-dev-mw01.serco.cms/mediawiki', '--username', 'jamal.nasir.adm', '--password', '{OMITTED}']

1%  Traceback (most recent call last):

  File "/usr/lib64/python2.7/site-packages/gevent/greenlet.py", line 534, in run

    result = self._run(*self.args, **self.kwargs)

  File "/usr/lib64/python2.7/site-packages/mwlib/apps/make_nuwiki.py", line 117, in run

    api = self.get_api()

  File "/usr/lib64/python2.7/site-packages/mwlib/apps/make_nuwiki.py", line 31, in get_api

    api.login(self.username, self.password, self.domain)

  File "/usr/lib64/python2.7/site-packages/mwlib/net/sapi.py", line 194, in login

    res = self._post(**args)

  File "/usr/lib64/python2.7/site-packages/mwlib/net/sapi.py", line 114, in _post

    res = loads(self._fetch(req))

  File "/usr/lib64/python2.7/site-packages/mwlib/net/sapi.py", line 80, in _fetch

    f = self.opener.open(url)

  File "/usr/lib64/python2.7/urllib2.py", line 446, in open

    response = meth(req, response)

  File "/usr/lib64/python2.7/urllib2.py", line 559, in http_response

    'http', request, response, code, msg, hdrs)

  File "/usr/lib64/python2.7/urllib2.py", line 484, in error

    return self._call_chain(*args)

  File "/usr/lib64/python2.7/urllib2.py", line 418, in _call_chain

    result = func(*args)

  File "/usr/lib64/python2.7/urllib2.py", line 567, in http_error_default

    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)

HTTPError: HTTP Error 401: Unauthorized

<Greenlet at 0x29fb910: <bound method start_fetcher.run of <mwlib.apps.make_nuwiki.start_fetcher object at 0x28991d0>>> failed with HTTPError

creating nuwiki in u'/root/cache/13/130c6a8548c2745b/tmpInmbhl/nuwiki'

removing tmpdir u'/root/cache/13/130c6a8548c2745b/tmpInmbhl'

memory used: res=21.4 virt=331.2

1% error Traceback (most recent call last):

  File "/bin/mw-zip", line 9, in <module>

    load_entry_point('mwlib==0.15.14', 'console_scripts', 'mw-zip')()

  File "/usr/lib64/python2.7/site-packages/mwlib/apps/buildzip.py", line 155, in main

    make_zip(output, options, env.metabook, podclient=podclient, status=status)

  File "/usr/lib64/python2.7/site-packages/mwlib/apps/buildzip.py", line 50, in make_zip

    make_nuwiki(fsdir, metabook=metabook, options=options, podclient=podclient, status=status)

  File "/usr/lib64/python2.7/site-packages/mwlib/apps/make_nuwiki.py", line 192, in make_nuwiki

    pool.join(raise_error=True)

  File "/usr/lib64/python2.7/site-packages/gevent/pool.py", line 524, in join

    greenlet._raise_exception()

  File "/usr/lib64/python2.7/site-packages/gevent/greenlet.py", line 171, in _raise_exception

    reraise(*self.exc_info)

  File "/usr/lib64/python2.7/site-packages/gevent/greenlet.py", line 534, in run

    result = self._run(*self.args, **self.kwargs)

  File "/usr/lib64/python2.7/site-packages/mwlib/apps/make_nuwiki.py", line 117, in run

    api = self.get_api()

  File "/usr/lib64/python2.7/site-packages/mwlib/apps/make_nuwiki.py", line 31, in get_api

    api.login(self.username, self.password, self.domain)

  File "/usr/lib64/python2.7/site-packages/mwlib/net/sapi.py", line 194, in login

    res = self._post(**args)

  File "/usr/lib64/python2.7/site-packages/mwlib/net/sapi.py", line 114, in _post

    res = loads(self._fetch(req))

  File "/usr/lib64/python2.7/site-packages/mwlib/net/sapi.py", line 80, in _fetch

    f = self.opener.open(url)

  File "/usr/lib64/python2.7/urllib2.py", line 446, in open

    response = meth(req, response)

  File "/usr/lib64/python2.7/urllib2.py", line 559, in http_response

    'http', request, response, code, msg, hdrs)

  File "/usr/lib64/python2.7/urllib2.py", line 484, in error

    return self._call_chain(*args)

  File "/usr/lib64/python2.7/urllib2.py", line 418, in _call_chain

    result = func(*args)

  File "/usr/lib64/python2.7/urllib2.py", line 567, in http_error_default

    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)

urllib2.HTTPError: HTTP Error 401: Unauthorized

Any idea on how to get around the 'urllib2.HTTPError: HTTP Error 401: Unauthorized' error? Jamal22066 (talk) 14:14, 20 October 2017 (UTC)

How to debug when using default value http://tools.pediapress.com/mw-serve/ for $wgCollectionMWServeURL

I am the admin on a low volume wiki that uses this extension. Our configuration uses the default value http://tools.pediapress.com/mw-serve/ for $wgCollectionMWServeURL.

Some of my users are periodically reporting that when they click on ''Download as PDF'', they sometimes get an error message: ''book rendering failed - there was an error while attempting to render your book''. 

Is there any log files/debug options that I can use and/or configure on my side to figure out the cause of the failed PDF rendering? Peculiar Investor (talk) 17:27, 10 December 2017 (UTC)