Näin saat toimimaan: YLE Areena ja Elävä arkisto

[nm]

Kuinka tuon yle-dl:n saa asennettua raspberry pi 3:n?

Onnistunee seuraamalla Debian Jessien ohjeistusta:

Asennus Debian Jessie (8.5)/Ubuntu 15.10 ja vanhemmat
-----------------------------------------------------

sudo apt-get install rtmpdump python python-crypto php5-cli php5-curl php5-mcrypt
sudo php5enmod mcrypt

sudo make install

Lisäksi tarvitset ffmpegin, joka onkin hankalampi juttu nykyisen Raspbianin kanssa. Kokeile sen sijaan avconvia, jonka pitäisi toimia tarpeeksi hyvin:

Koodia: [Valitse]

sudo apt-get install libav-tools

Käyttö onnistuu valitsimella --ffmpeg /usr/bin/avconv

Koodia: [Valitse]

yle-dl --ffmpeg /usr/bin/avconv http://areena.yle.fi/1-2507784

[AimoE]

Tuo parametri "-o monsuuni" ei kyllä toimi nykyisellä yle-dl 2.17:lla. Siihen pitää lisätä ffmpegin ymmärtämä tiedostopääte:

Koodia: [Valitse]

yle-dl http://areena.yle.fi/1-2507784 -o monsuuni.mp4

Mikä herättää kysymyksen pitääkö joka ohjelman kanssa erikseen valita pääte kun edelleen on ohjelmia jotka ovat tarjolla vain .flv-muodossa, mutta onneksi tuo .mp4 kelpaa yle-dl-työkalulle; se vaihtaa päätteen .flv:ksi tarvittaessa eikä jätä väärää päätettä jäljelle. Tämä oli iso helpotus kun tein oman wrapperin joka muuntaa ladattujen tiedostojen nimet mielekkämpään muotoon. Scriptin ei tarvitse kysyä mitän, vaan se voi suoraan tökätä tuon .mp4:n kaikille.

Nyt kun vielä Yle yhdenmukaistaisi ohjelmien tiedot niin että saisin kaiken automatisoiduksi. Nimissä on vielä liikaa hajontaa. Eisimerkiksi sarjan Vastavirtaan jaksot haluan tietenkin ladata nimillä joissa Vastavirtaan on prefiksinä, mutta tarjolla on paljon ohjelmia joiden nimissä on ihan tarpeeton prefiksi, kuten Dokumenttiprojekti, tai Dok tai Kino Suomi. Ja sitten on kaikenlaista muuta jäynää. Jouduin vielä toistaiseksi tyytymään wrapperiin joka kysyy missä mudossa haluan ohjelman nimen. Tälllä hetkellä perustan sen siihen että yle-dl:n antamassa nimessä on ensin yksi tai useampi merkeillä ': ' erotettu osa ja stten aikaleima. Wrapperini erottaa osat ja kysyy mitkä niistä haluan poimia mukaan. Hankalaa mutta eipä tuota latausta niin hirveän usein tule tehtyä.

[nm]

Nyt kun vielä Yle yhdenmukaistaisi ohjelmien tiedot niin että saisin kaiken automatisoiduksi. Nimissä on vielä liikaa hajontaa. Eisimerkiksi sarjan Vastavirtaan jaksot haluan tietenkin ladata nimillä joissa Vastavirtaan on prefiksinä, mutta tarjolla on paljon ohjelmia joiden nimissä on ihan tarpeeton prefiksi, kuten Dokumenttiprojekti, tai Dok tai Kino Suomi.

Itse tekisin tuota varten sed-skriptin, jonka läpi kaikki nimet ajetaan:

fix_yle_naming.sed

# Sed script to clean up Yle program naming

s/^Kino [[:alpha:]]*: //
s/^Dokumenttiprojekti: //
s/^Dok: //

Koodia: [Valitse]

echo "Kino Suomi: Mies vailla menneisyyttä" | sed -f fix_yle_naming.sed

Mies vailla menneisyyttä

Tiedostoon on sitten helppo lisäillä uusia sääntöjä tarpeen mukaan.

[Cultor]

VLC ei tosiaan taida vieläkään tykätä ffmpegillä kirjoitetuista MKV-tiedostoista. Näkyy olevan edelleen ongelmallinen kombinaatio uusimmillakin ohjelmaversioilla. Paras käyttää MP4-formaattia, jos ladattuja tiedostoja on tarkoitus säilyttää ja katsella erilaisissa ympäristöissä muilla kuin FFmpeg/libavformat-pohjaisilla soittimilla.

Vakaalla versiolla 2.22 (myös 2.21) ladattua html5-videota (mp4) voi katsoa kesken latauksen VLC:llä ja varmaan millä tahansa videosoittimella. Suorien tallennukseen yle-dl näyttää käyttävän AdobeHDS:ää.

[AimoE]

Vakaalla versiolla 2.22 (myös 2.21) ladattua html5-videota (mp4) voi katsoa kesken latauksen VLC:llä ja varmaan millä tahansa videosoittimella. Suorien tallennukseen yle-dl näyttää käyttävän AdobeHDS:ää.

Nyt kun paketissa ei enää ole makefile mukana, niin voisi vähän valaista miten asennus nyt tehdään Ubuntulla. Katsoin jo Readme-tiedoston ja ajoin ne asennukset jotka siellä neuvotaan, mutta kun yritin sudo pip install yle-dl -komentoa, niin systeemi sanoo ettei tunne pip-komentoa. Lisäksi ohje php.ini -tiedoston editoinnista on hämärä, koska se on kirjoitettu geneerisesti monelle käyttikselle.

Miten asennus tehdään Ubuntu16.04 LTS:lle?

Korjaus: pip -komento löytyy, mutta siitä tulee virheilmoitus:

Koodia: [Valitse]

You are using pip version 8.1.1, however version 9.0.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
kun tuon komennon suorittaa, niin asennus ilmeisesti onnistuu, vaikkakin ilmoitukset ovat mystisiä. En ole koskaan ennen ollut tekemisissä koko pip:n kanssa.

[raimo]

Vakaalla versiolla 2.22 (myös 2.21) ladattua html5-videota (mp4) voi katsoa kesken latauksen VLC:llä ja varmaan millä tahansa videosoittimella. Suorien tallennukseen yle-dl näyttää käyttävän AdobeHDS:ää.

Nyt kun paketissa ei enää ole makefile mukana, niin voisi vähän valaista miten asennus nyt tehdään Ubuntulla. Katsoin jo Readme-tiedoston ja ajoin ne asennukset jotka siellä neuvotaan, mutta kun yritin sudo pip install yle-dl -komentoa, niin systeemi sanoo ettei tunne pip-komentoa. Lisäksi ohje php.ini -tiedoston editoinnista on hämärä, koska se on kirjoitettu geneerisesti monelle käyttikselle.

Miten asennus tehdään Ubuntu16.04 LTS:lle?

Korjaus: pip -komento löytyy, mutta siitä tulee virheilmoitus:

Koodia: [Valitse]

You are using pip version 8.1.1, however version 9.0.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
kun tuon komennon suorittaa, niin asennus ilmeisesti onnistuu, vaikkakin ilmoitukset ovat mystisiä. En ole koskaan ennen ollut tekemisissä koko pip:n kanssa.

Minulla meni näin:

Koodia: [Valitse]

sudo apt-get install rtmpdump python python-pip python-setuptools python-crypto python-requests python-progress php-cli php-curl php-mcrypt php-xml php-bcmath

Koodia: [Valitse]

sudo phpenmod mcrypt
PIP valittaa tuon jälkeen uudemmasta versiosta, sen saa näin:

Koodia: [Valitse]

pip install --upgrade pip

Koodia: [Valitse]

sudo -H pip install yle-dlMinulla sudo vaati/ehdotti tuota -H vipua, en jaksa tonkia mitä se tekee kun asennus sen kanssa meni virheittä ja yle-dl toimii.

[Cultor]

Yle-dl 2.22 readme.fi

Asenna yle-dl
-------------

Yksinkertainen tapa (ei vaadi lähdekoodien lataamista):

sudo pip install yle-dl

Vaihtoehtoinen tapa: lataa lähdekoodit ja aja lähdekoodihakemistossa:

sudo python setup.py install

Itse käytän jälkimmäistä tapaa, koska puukotan excludechars riviä ennen asennusta.

[Illu]

Yle-dl 2.22 readme.fi

Asenna yle-dl
-------------

Yksinkertainen tapa (ei vaadi lähdekoodien lataamista):

sudo pip install yle-dl

Vaihtoehtoinen tapa: lataa lähdekoodit ja aja lähdekoodihakemistossa:

sudo python setup.py install

Itse käytän jälkimmäistä tapaa, koska puukotan excludechars riviä ennen asennusta.

Ja mulla ei tuo ensimmäinen toimikaan, jälkimmäinen kyllä.

[nm]

Yle-dl 2.22 readme.fi

Asenna yle-dl
-------------

Yksinkertainen tapa (ei vaadi lähdekoodien lataamista):

sudo pip install yle-dl

Vaihtoehtoinen tapa: lataa lähdekoodit ja aja lähdekoodihakemistossa:

sudo python setup.py install

Itse käytän jälkimmäistä tapaa, koska puukotan excludechars riviä ennen asennusta.

Ja mulla ei tuo ensimmäinen toimikaan, jälkimmäinen kyllä.

Asensitko paketin python-pip (muiden tarvittavien riippuvuuksien lisäksi)

[Illu]

Asensitko paketin python-pip (muiden tarvittavien riippuvuuksien lisäksi)

Käyn silloin tällöin kurkkaamassa, onko uutta yle-dl pakettia tullut. 2.20 oli ensimmäinen, joka ei asentunutkaan "sudo make jne." menetelmällä. Sitten hoksasin asennusohjeissa tuon pipin. Asensin sen ja 2.20 asentui. 2.21 ei asentunutkaan mutta Cultorin mainitsema

Koodia: [Valitse]

sudo python setup.py install hoiti homman. Ja nyt myös 2.22 versiolla. Ei kai tuolla lopulta mitään väliä ole, miten asentuu, kunhan toimii?

[AimoE]

Ei kai tuolla lopulta mitään väliä ole, miten asentuu, kunhan toimii?

Olisi siitä kuitenkin voinut jotain mainita täällä foorumilla, ettei olisi tullut niin yllättäen, olisi voinut vähän varautua.

[nm]

Käyn silloin tällöin kurkkaamassa, onko uutta yle-dl pakettia tullut. 2.20 oli ensimmäinen, joka ei asentunutkaan "sudo make jne." menetelmällä. Sitten hoksasin asennusohjeissa tuon pipin. Asensin sen ja 2.20 asentui. 2.21 ei asentunutkaan

Asennettujen pakettien päivitys onnistuu pip installin vivulla --upgrade:

Koodia: [Valitse]

sudo pip install --upgrade yle-dl

Ei kai tuolla lopulta mitään väliä ole, miten asentuu, kunhan toimii?

Olisi siitä kuitenkin voinut jotain mainita täällä foorumilla, ettei olisi tullut niin yllättäen, olisi voinut vähän varautua.

Luulenpa, ettei Antilla ole aikaa ja intoa toimia ilmaisena tukipalveluna satunnaisilla foorumeilla.

[Illu]

Mikähän nyt tökkii?

Koodia: [Valitse]

ilkka@kotikone:~$ yle-dl https://areena.yle.fi/1-4232503
Traceback (most recent call last):
  File "/usr/local/bin/yle-dl", line 5, in <module>
    from pkg_resources import load_entry_point
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 2749, in <module>
    working_set = WorkingSet._build_master()
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 444, in _build_master
    ws.require(__requires__)
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 725, in require
    needed = self.resolve(parse_requirements(requirements))
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 628, in resolve
    raise DistributionNotFound(req)
pkg_resources.DistributionNotFound: cryptography>=1.9

Lataus ei siis onnistu, käytössä yle-dl 2.23.

[nm]

Mikähän nyt tökkii?

Koodia: [Valitse]

pkg_resources.DistributionNotFound: cryptography>=1.9


Python-moduuli cryptography puuttuu. Se on riippuvuutena pyOpenSSL:lle, joka on uusimmassa yle-dl:n versiossa vaatimuksena, jos Python on vanhempi kuin 2.7.9: https://github.com/aajanki/yle-dl/commit/86091fca7142299f61ea25afcb4b67c192466892#diff-2eeaed663bd0d25b7e608891384b7298
Näin on esimerkiksi Ubuntu 14.04:ssä.

Jos ja kun jakelusi on Ubuntu 14.04 (tai Debian 8 ), varmista ensin että nämä paketit on asennettu:

Koodia: [Valitse]

sudo apt-get install rtmpdump python python-setuptools python-pip python-crypto python-requests python-lxml php5-cli php5-curl php5-mcrypt
ja cryptographyn kääntämiseen tarvittavat työkalut ja headerit:

Koodia: [Valitse]

sudo apt-get install build-essential libssl-dev libffi-dev python-dev
Asenna sitten yle-dl uudelleen. Sen pitäisi vetää cryptography ja muut tarvittavat moduulit mukanaan, kunhan niiden kääntäminen onnistuu:

Koodia: [Valitse]

sudo pip install --upgrade yle-dl

[Illu]

Juu, unohdin mainita jakelun Ubuntu 14.04. Pitää kokeilla nuo loitsut, kun viikonlopun päätteeksi taas olen kotosalla.

[Illu]

Muut komennot sujuivat, mutta yle-dl päivitys ei.

Koodia: [Valitse]

ilkka@kotikone:~/temp$ sudo pip install --upgrade yle-dl
Requirement already up-to-date: yle-dl in /usr/local/lib/python2.7/dist-packages
Requirement already up-to-date: pycrypto in /usr/lib/python2.7/dist-packages (from yle-dl)
Requirement already up-to-date: requests in /usr/local/lib/python2.7/dist-packages (from yle-dl)
Requirement already up-to-date: progress in /usr/local/lib/python2.7/dist-packages (from yle-dl)
Downloading/unpacking lxml from https://pypi.python.org/packages/07/76/9f14811d3fb91ed7973a798ded15eda416070bbcb1aadc6a5af9d691d993/lxml-4.0.0.tar.gz#md5=c30d7e752cc909c1c0c40bd34153443a (from yle-dl)
  Downloading lxml-4.0.0.tar.gz (4.2MB): 4.2MB downloaded
  Running setup.py (path:/tmp/pip_build_root/lxml/setup.py) egg_info for package lxml
    Building lxml version 4.0.0.
    Building without Cython.
    ERROR: /bin/sh: 1: xslt-config: not found
   
    ** make sure the development packages of libxml2 and libxslt are installed **
   
    Using build configuration of libxslt
   
    warning: no previously-included files found matching '*.py'
Downloading/unpacking pyOpenSSL from https://pypi.python.org/packages/24/37/89bf12e53f1d27e8b2c8e5f8f9c7a958a3905f6916a9294a57a9d83fa165/pyOpenSSL-17.3.0-py2.py3-none-any.whl#md5=4217027ddfa4182d7f3b425d0b5eac92 (from yle-dl)
  Downloading pyOpenSSL-17.3.0-py2.py3-none-any.whl (51kB): 51kB downloaded
Requirement already up-to-date: ndg-httpsclient in /usr/local/lib/python2.7/dist-packages (from yle-dl)
Downloading/unpacking pyasn1 from https://pypi.python.org/packages/bf/56/47712763865a8639e6634e80405f6c758d4415620725896f412c464705f0/pyasn1-0.3.6-py2.py3-none-any.whl#md5=4bf6bae8225ccc04ba3e900b3798a0da (from yle-dl)
  Downloading pyasn1-0.3.6-py2.py3-none-any.whl (63kB): 63kB downloaded
Downloading/unpacking six>=1.5.2 from https://pypi.python.org/packages/67/4b/141a581104b1f6397bfa78ac9d43d8ad29a7ca43ea90a2d863fe3056e86a/six-1.11.0-py2.py3-none-any.whl#md5=866ab722be6bdfed6830f3179af65468 (from pyOpenSSL->yle-dl)
  Downloading six-1.11.0-py2.py3-none-any.whl
Downloading/unpacking cryptography>=1.9 (from pyOpenSSL->yle-dl)
  Downloading cryptography-2.0.3.tar.gz (427kB): 427kB downloaded
  Running setup.py (path:/tmp/pip_build_root/cryptography/setup.py) egg_info for package cryptography
   
    no previously-included directories found matching 'docs/_build'
    warning: no previously-included files matching '*' found under directory 'vectors'
Requirement already up-to-date: idna>=2.1 in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.9->pyOpenSSL->yle-dl)
Downloading/unpacking asn1crypto>=0.21.0 (from cryptography>=1.9->pyOpenSSL->yle-dl)
  Downloading asn1crypto-0.23.0-py2.py3-none-any.whl (99kB): 99kB downloaded
Downloading/unpacking enum34 (from cryptography>=1.9->pyOpenSSL->yle-dl)
  Downloading enum34-1.1.6-py2-none-any.whl
Downloading/unpacking ipaddress (from cryptography>=1.9->pyOpenSSL->yle-dl)
  Downloading ipaddress-1.0.18-py2-none-any.whl
Downloading/unpacking cffi>=1.7 (from cryptography>=1.9->pyOpenSSL->yle-dl)
  Downloading cffi-1.11.0.tar.gz (434kB): 434kB downloaded
  Running setup.py (path:/tmp/pip_build_root/cffi/setup.py) egg_info for package cffi
   
Downloading/unpacking pycparser (from cffi>=1.7->cryptography>=1.9->pyOpenSSL->yle-dl)
  Downloading pycparser-2.18.tar.gz (245kB): 245kB downloaded
  Running setup.py (path:/tmp/pip_build_root/pycparser/setup.py) egg_info for package pycparser
   
    warning: no previously-included files matching 'yacctab.*' found under directory 'tests'
    warning: no previously-included files matching 'lextab.*' found under directory 'tests'
    warning: no previously-included files matching 'yacctab.*' found under directory 'examples'
    warning: no previously-included files matching 'lextab.*' found under directory 'examples'
Installing collected packages: lxml, pyOpenSSL, pyasn1, six, cryptography, asn1crypto, enum34, ipaddress, cffi, pycparser
  Found existing installation: lxml 3.3.3
    Not uninstalling lxml at /usr/lib/python2.7/dist-packages, owned by OS
  Running setup.py install for lxml
    Building lxml version 4.0.0.
    Building without Cython.
    ERROR: /bin/sh: 1: xslt-config: not found
   
    ** make sure the development packages of libxml2 and libxslt are installed **
   
    Using build configuration of libxslt
    building 'lxml.etree' extension
    x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Isrc -Isrc/lxml/includes -I/usr/include/python2.7 -c src/lxml/etree.c -o build/temp.linux-x86_64-2.7/src/lxml/etree.o -w
    In file included from src/lxml/etree.c:572:0:
    src/lxml/includes/etree_defs.h:14:31: fatal error: libxml/xmlversion.h: Tiedostoa tai hakemistoa ei ole
     #include "libxml/xmlversion.h"
                                   ^
    compilation terminated.
    Compile failed: command 'x86_64-linux-gnu-gcc' failed with exit status 1
    cc -I/usr/include/libxml2 -c /tmp/xmlXPathInit48eVpU.c -o tmp/xmlXPathInit48eVpU.o
    /tmp/xmlXPathInit48eVpU.c:1:26: fatal error: libxml/xpath.h: Tiedostoa tai hakemistoa ei ole
     #include "libxml/xpath.h"
                              ^
    compilation terminated.
    *********************************************************************************
    Could not find function xmlCheckVersion in library libxml2. Is libxml2 installed?
    *********************************************************************************
    error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
    Complete output from command /usr/bin/python -c "import setuptools, tokenize;__file__='/tmp/pip_build_root/lxml/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-J53QUc-record/install-record.txt --single-version-externally-managed --compile:
    Building lxml version 4.0.0.

Building without Cython.

ERROR: /bin/sh: 1: xslt-config: not found



** make sure the development packages of libxml2 and libxslt are installed **



Using build configuration of libxslt

running install

running build

running build_py

creating build

creating build/lib.linux-x86_64-2.7

creating build/lib.linux-x86_64-2.7/lxml

copying src/lxml/ElementInclude.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/__init__.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/sax.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/doctestcompare.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/cssselect.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/usedoctest.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/pyclasslookup.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/_elementpath.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/builder.py -> build/lib.linux-x86_64-2.7/lxml

creating build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/__init__.py -> build/lib.linux-x86_64-2.7/lxml/includes

creating build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/__init__.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/_diffcommand.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/html5parser.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/_html5builder.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/diff.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/clean.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/usedoctest.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/defs.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/ElementSoup.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/_setmixin.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/soupparser.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/formfill.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/builder.py -> build/lib.linux-x86_64-2.7/lxml/html

creating build/lib.linux-x86_64-2.7/lxml/isoschematron

copying src/lxml/isoschematron/__init__.py -> build/lib.linux-x86_64-2.7/lxml/isoschematron

copying src/lxml/etree.h -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/etree_api.h -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/lxml.etree.h -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/lxml.etree_api.h -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/includes/htmlparser.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/c14n.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/xmlschema.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/uri.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/dtdvalid.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/xmlerror.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/xpath.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/config.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/tree.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/xmlparser.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/etreepublic.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/__init__.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/relaxng.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/xinclude.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/schematron.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/xslt.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/lxml-version.h -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/etree_defs.h -> build/lib.linux-x86_64-2.7/lxml/includes

creating build/lib.linux-x86_64-2.7/lxml/isoschematron/resources

creating build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/rng

copying src/lxml/isoschematron/resources/rng/iso-schematron.rng -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/rng

creating build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl

copying src/lxml/isoschematron/resources/xsl/RNG2Schtrn.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl

copying src/lxml/isoschematron/resources/xsl/XSD2Schtrn.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl

creating build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_svrl_for_xslt1.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_schematron_skeleton_for_xslt1.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_dsdl_include.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_schematron_message.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_abstract_expand.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/readme.txt -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

running build_ext

building 'lxml.etree' extension

creating build/temp.linux-x86_64-2.7

creating build/temp.linux-x86_64-2.7/src

creating build/temp.linux-x86_64-2.7/src/lxml

x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -Isrc -Isrc/lxml/includes -I/usr/include/python2.7 -c src/lxml/etree.c -o build/temp.linux-x86_64-2.7/src/lxml/etree.o -w

In file included from src/lxml/etree.c:572:0:

src/lxml/includes/etree_defs.h:14:31: fatal error: libxml/xmlversion.h: Tiedostoa tai hakemistoa ei ole

 #include "libxml/xmlversion.h"

                               ^

compilation terminated.

Compile failed: command 'x86_64-linux-gnu-gcc' failed with exit status 1

creating tmp

cc -I/usr/include/libxml2 -c /tmp/xmlXPathInit48eVpU.c -o tmp/xmlXPathInit48eVpU.o

/tmp/xmlXPathInit48eVpU.c:1:26: fatal error: libxml/xpath.h: Tiedostoa tai hakemistoa ei ole

 #include "libxml/xpath.h"

                          ^

compilation terminated.

*********************************************************************************

Could not find function xmlCheckVersion in library libxml2. Is libxml2 installed?

*********************************************************************************

error: command 'x86_64-linux-gnu-gcc' failed with exit status 1

----------------------------------------
  Can't roll back lxml; was not uninstalled
Cleaning up...
Command /usr/bin/python -c "import setuptools, tokenize;__file__='/tmp/pip_build_root/lxml/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-J53QUc-record/install-record.txt --single-version-externally-managed --compile failed with error code 1 in /tmp/pip_build_root/lxml
Storing debug log for failure in /home/ilkka/.pip/pip.log
ilkka@kotikone:~/temp$ yle-dl
Traceback (most recent call last):
  File "/usr/local/bin/yle-dl", line 5, in <module>
    from pkg_resources import load_entry_point
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 2749, in <module>
    working_set = WorkingSet._build_master()
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 444, in _build_master
    ws.require(__requires__)
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 725, in require
    needed = self.resolve(parse_requirements(requirements))
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 628, in resolve
    raise DistributionNotFound(req)
pkg_resources.DistributionNotFound: cryptography>=1.9
ilkka@kotikone:~/temp$

Mitä nyt teen?

[nm]

    ERROR: /bin/sh: 1: xslt-config: not found
   
    ** make sure the development packages of libxml2 and libxslt are installed **

Asenna paketit libxml2-dev ja libxslt1-dev:

Koodia: [Valitse]

sudo apt-get install libxml2-dev libxslt1-dev

[Illu]

No nyt toimii taas, kiitos!

[ls]

Päivitys uusimpaan tökkii:

Koodia: [Valitse]

src/lxml/etree.c:91:20: fatal error: Python.h: Tiedostoa tai hakemistoa ei ole
Koko rimpsu:

Koodia: [Valitse]

sudo pip install --upgrade yle-dl
Requirement already up-to-date: yle-dl in /usr/local/lib/python2.7/dist-packages
Requirement already up-to-date: pycrypto in /usr/lib/python2.7/dist-packages (from yle-dl)
Downloading/unpacking requests from https://pypi.python.org/packages/49/df/50aa1999ab9bde74656c2919d9c0c085fd2b3775fd3eca826012bef76d8c/requests-2.18.4-py2.py3-none-any.whl#md5=eb9be71cc41fd73a51a7c9cd1adde5de (from yle-dl)
  Downloading requests-2.18.4-py2.py3-none-any.whl (88kB): 88kB downloaded
Requirement already up-to-date: progress in /usr/local/lib/python2.7/dist-packages (from yle-dl)
Downloading/unpacking lxml from https://pypi.python.org/packages/07/76/9f14811d3fb91ed7973a798ded15eda416070bbcb1aadc6a5af9d691d993/lxml-4.0.0.tar.gz#md5=c30d7e752cc909c1c0c40bd34153443a (from yle-dl)
  Downloading lxml-4.0.0.tar.gz (4.2MB): 4.2MB downloaded
  Running setup.py (path:/tmp/pip_build_root/lxml/setup.py) egg_info for package lxml
    Building lxml version 4.0.0.
    Building without Cython.
    Using build configuration of libxslt 1.1.28
   
    warning: no previously-included files found matching '*.py'
Downloading/unpacking pyOpenSSL from https://pypi.python.org/packages/24/37/89bf12e53f1d27e8b2c8e5f8f9c7a958a3905f6916a9294a57a9d83fa165/pyOpenSSL-17.3.0-py2.py3-none-any.whl#md5=4217027ddfa4182d7f3b425d0b5eac92 (from yle-dl)
  Downloading pyOpenSSL-17.3.0-py2.py3-none-any.whl (51kB): 51kB downloaded
Downloading/unpacking ndg-httpsclient from https://pypi.python.org/packages/64/05/3b7b745509609e4a756792610c4246350342ad12585d399b9290e04aa26f/ndg_httpsclient-0.4.3-py2-none-any.whl#md5=8a92688261dedbab38a7c99348254ac9 (from yle-dl)
  Downloading ndg_httpsclient-0.4.3-py2-none-any.whl
Downloading/unpacking pyasn1 from https://pypi.python.org/packages/31/fd/08e985cb75c39157cd066b709298c8d027c54a790bf9b265097c5444c336/pyasn1-0.3.7-py2.py3-none-any.whl#md5=c0e2903f40801aa7d533e0c206758c51 (from yle-dl)
  Downloading pyasn1-0.3.7-py2.py3-none-any.whl (63kB): 63kB downloaded
Requirement already up-to-date: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests->yle-dl)
Requirement already up-to-date: idna>=2.5,<2.7 in /usr/local/lib/python2.7/dist-packages (from requests->yle-dl)
Downloading/unpacking chardet>=3.0.2,<3.1.0 (from requests->yle-dl)
  Downloading chardet-3.0.4-py2.py3-none-any.whl (133kB): 133kB downloaded
Downloading/unpacking urllib3>=1.21.1,<1.23 (from requests->yle-dl)
  Downloading urllib3-1.22-py2.py3-none-any.whl (132kB): 132kB downloaded
Downloading/unpacking six>=1.5.2 from https://pypi.python.org/packages/67/4b/141a581104b1f6397bfa78ac9d43d8ad29a7ca43ea90a2d863fe3056e86a/six-1.11.0-py2.py3-none-any.whl#md5=866ab722be6bdfed6830f3179af65468 (from pyOpenSSL->yle-dl)
  Downloading six-1.11.0-py2.py3-none-any.whl
Downloading/unpacking cryptography>=1.9 (from pyOpenSSL->yle-dl)
  Downloading cryptography-2.0.3.tar.gz (427kB): 427kB downloaded
  Running setup.py (path:/tmp/pip_build_root/cryptography/setup.py) egg_info for package cryptography
   
    no previously-included directories found matching 'docs/_build'
    warning: no previously-included files matching '*' found under directory 'vectors'
Downloading/unpacking asn1crypto>=0.21.0 (from cryptography>=1.9->pyOpenSSL->yle-dl)
  Downloading asn1crypto-0.23.0-py2.py3-none-any.whl (99kB): 99kB downloaded
Downloading/unpacking enum34 (from cryptography>=1.9->pyOpenSSL->yle-dl)
  Downloading enum34-1.1.6-py2-none-any.whl
Downloading/unpacking ipaddress (from cryptography>=1.9->pyOpenSSL->yle-dl)
  Downloading ipaddress-1.0.18-py2-none-any.whl
Downloading/unpacking cffi>=1.7 (from cryptography>=1.9->pyOpenSSL->yle-dl)
  Downloading cffi-1.11.2.tar.gz (435kB): 435kB downloaded
  Running setup.py (path:/tmp/pip_build_root/cffi/setup.py) egg_info for package cffi
   
Downloading/unpacking pycparser (from cffi>=1.7->cryptography>=1.9->pyOpenSSL->yle-dl)
  Downloading pycparser-2.18.tar.gz (245kB): 245kB downloaded
  Running setup.py (path:/tmp/pip_build_root/pycparser/setup.py) egg_info for package pycparser
   
    warning: no previously-included files matching 'yacctab.*' found under directory 'tests'
    warning: no previously-included files matching 'lextab.*' found under directory 'tests'
    warning: no previously-included files matching 'yacctab.*' found under directory 'examples'
    warning: no previously-included files matching 'lextab.*' found under directory 'examples'
Installing collected packages: requests, lxml, pyOpenSSL, ndg-httpsclient, pyasn1, chardet, urllib3, six, cryptography, asn1crypto, enum34, ipaddress, cffi, pycparser
  Found existing installation: requests 2.2.1
    Not uninstalling requests at /usr/lib/python2.7/dist-packages, owned by OS
  Found existing installation: lxml 3.3.3
    Not uninstalling lxml at /usr/lib/python2.7/dist-packages, owned by OS
  Running setup.py install for lxml
    Building lxml version 4.0.0.
    Building without Cython.
    Using build configuration of libxslt 1.1.28
    building 'lxml.etree' extension
    x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -I/usr/include/libxml2 -Isrc -Isrc/lxml/includes -I/usr/include/python2.7 -c src/lxml/etree.c -o build/temp.linux-x86_64-2.7/src/lxml/etree.o -w
    src/lxml/etree.c:91:20: fatal error: Python.h: Tiedostoa tai hakemistoa ei ole
     #include "Python.h"
                        ^
    compilation terminated.
    Compile failed: command 'x86_64-linux-gnu-gcc' failed with exit status 1
    cc -I/usr/include/libxml2 -I/usr/include/libxml2 -c /tmp/xmlXPathInite5sCSA.c -o tmp/xmlXPathInite5sCSA.o
    cc tmp/xmlXPathInite5sCSA.o -lxml2 -o a.out
    error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
    Complete output from command /usr/bin/python -c "import setuptools, tokenize;__file__='/tmp/pip_build_root/lxml/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-tFMrsp-record/install-record.txt --single-version-externally-managed --compile:
    Building lxml version 4.0.0.

Building without Cython.

Using build configuration of libxslt 1.1.28

running install

running build

running build_py

creating build

creating build/lib.linux-x86_64-2.7

creating build/lib.linux-x86_64-2.7/lxml

copying src/lxml/builder.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/usedoctest.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/doctestcompare.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/sax.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/pyclasslookup.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/ElementInclude.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/cssselect.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/__init__.py -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/_elementpath.py -> build/lib.linux-x86_64-2.7/lxml

creating build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/__init__.py -> build/lib.linux-x86_64-2.7/lxml/includes

creating build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/_setmixin.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/_html5builder.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/builder.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/ElementSoup.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/defs.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/clean.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/usedoctest.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/diff.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/formfill.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/__init__.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/_diffcommand.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/html5parser.py -> build/lib.linux-x86_64-2.7/lxml/html

copying src/lxml/html/soupparser.py -> build/lib.linux-x86_64-2.7/lxml/html

creating build/lib.linux-x86_64-2.7/lxml/isoschematron

copying src/lxml/isoschematron/__init__.py -> build/lib.linux-x86_64-2.7/lxml/isoschematron

copying src/lxml/etree.h -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/etree_api.h -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/lxml.etree.h -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/lxml.etree_api.h -> build/lib.linux-x86_64-2.7/lxml

copying src/lxml/includes/xmlerror.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/xslt.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/htmlparser.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/config.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/__init__.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/xmlschema.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/uri.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/relaxng.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/etreepublic.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/xpath.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/tree.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/c14n.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/dtdvalid.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/xmlparser.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/schematron.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/xinclude.pxd -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/etree_defs.h -> build/lib.linux-x86_64-2.7/lxml/includes

copying src/lxml/includes/lxml-version.h -> build/lib.linux-x86_64-2.7/lxml/includes

creating build/lib.linux-x86_64-2.7/lxml/isoschematron/resources

creating build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/rng

copying src/lxml/isoschematron/resources/rng/iso-schematron.rng -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/rng

creating build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl

copying src/lxml/isoschematron/resources/xsl/XSD2Schtrn.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl

copying src/lxml/isoschematron/resources/xsl/RNG2Schtrn.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl

creating build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_dsdl_include.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_schematron_skeleton_for_xslt1.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_svrl_for_xslt1.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_schematron_message.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_abstract_expand.xsl -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/readme.txt -> build/lib.linux-x86_64-2.7/lxml/isoschematron/resources/xsl/iso-schematron-xslt1

running build_ext

building 'lxml.etree' extension

creating build/temp.linux-x86_64-2.7

creating build/temp.linux-x86_64-2.7/src

creating build/temp.linux-x86_64-2.7/src/lxml

x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -I/usr/include/libxml2 -Isrc -Isrc/lxml/includes -I/usr/include/python2.7 -c src/lxml/etree.c -o build/temp.linux-x86_64-2.7/src/lxml/etree.o -w

src/lxml/etree.c:91:20: fatal error: Python.h: Tiedostoa tai hakemistoa ei ole

 #include "Python.h"

                    ^

compilation terminated.

Compile failed: command 'x86_64-linux-gnu-gcc' failed with exit status 1

creating tmp

cc -I/usr/include/libxml2 -I/usr/include/libxml2 -c /tmp/xmlXPathInite5sCSA.c -o tmp/xmlXPathInite5sCSA.o

cc tmp/xmlXPathInite5sCSA.o -lxml2 -o a.out

error: command 'x86_64-linux-gnu-gcc' failed with exit status 1

----------------------------------------
  Can't roll back lxml; was not uninstalled
Cleaning up...
Command /usr/bin/python -c "import setuptools, tokenize;__file__='/tmp/pip_build_root/lxml/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-tFMrsp-record/install-record.txt --single-version-externally-managed --compile failed with error code 1 in /tmp/pip_build_root/lxml
Storing debug log for failure in /home/late/.pip/pip.log
Sain kyllä toimivan version 2.23 asennettua uudestaan lataamalla koodit, vaikka silloinkin tuli joku python.h-error.

[nm]

Päivitys uusimpaan tökkii:

Koodia: [Valitse]

src/lxml/etree.c:91:20: fatal error: Python.h: Tiedostoa tai hakemistoa ei ole

Asenna python-dev:

Koodia: [Valitse]

sudo apt-get install python-dev