Goto django 1.9

[yomguy]

[AnasGhrab]

Excellent news !

[lluc]

👍

[AnasGhrab]

When trying the dj1.9 version with docker, I got :

ImportError: No module named importlib

[thomasfillon]

Hi Anas !
Did you use the feature/dj1.9 branch ?

[AnasGhrab]

@thomasfillon : Yes, of course... !

Zeus:Telemeta anas$ git checkout dj1.9
M	lib/TimeSide
M	telemeta/pages
Already on 'dj1.9'
Your branch is up-to-date with 'origin/feature/dj1.9'.

Zeus:Telemeta anas$ docker-compose -f docker-compose.yml -f env/dev.yml up

app_1         | 3306...ok
app_1         | Traceback (most recent call last):
app_1         |   File "/srv/app/manage.py", line 7, in <module>
app_1         |     execute_from_command_line(sys.argv)
app_1         |   File "/opt/miniconda/lib/python2.7/site-packages/django/core/management/__init__.py", line 353, in execute_from_command_line
app_1         |     utility.execute()
app_1         |   File "/opt/miniconda/lib/python2.7/site-packages/django/core/management/__init__.py", line 327, in execute
app_1         |     django.setup()
app_1         |   File "/opt/miniconda/lib/python2.7/site-packages/django/__init__.py", line 18, in setup
app_1         |     apps.populate(settings.INSTALLED_APPS)
app_1         |   File "/opt/miniconda/lib/python2.7/site-packages/django/apps/registry.py", line 85, in populate
app_1         |     app_config = AppConfig.create(entry)
app_1         |   File "/opt/miniconda/lib/python2.7/site-packages/django/apps/config.py", line 123, in create
app_1         |     import_module(entry)
app_1         |   File "/opt/miniconda/lib/python2.7/importlib/__init__.py", line 37, in import_module
app_1         |     __import__(name)
app_1         |   File "/srv/src/sorl-thumbnail/sorl/thumbnail/__init__.py", line 1, in <module>
app_1         |     from sorl.thumbnail.fields import ImageField
app_1         |   File "/srv/src/sorl-thumbnail/sorl/thumbnail/fields.py", line 8, in <module>
app_1         |     from sorl.thumbnail import default
app_1         |   File "/srv/src/sorl-thumbnail/sorl/thumbnail/default.py", line 4, in <module>
app_1         |     from sorl.thumbnail.helpers import get_module_class
app_1         |   File "/srv/src/sorl-thumbnail/sorl/thumbnail/helpers.py", line 6, in <module>
app_1         |     from django.utils.importlib import import_module
app_1         | ImportError: No module named importlib
app_1         | Unhandled exception in thread started by <function wrapper at 0x7f77b3a889b0>
app_1         | Traceback (most recent call last):
app_1         |   File "/opt/miniconda/lib/python2.7/site-packages/django/utils/autoreload.py", line 226, in wrapper
app_1         |     fn(*args, **kwargs)
app_1         |   File "/opt/miniconda/lib/python2.7/site-packages/django/core/management/commands/runserver.py", line 109, in inner_run
app_1         |     autoreload.raise_last_exception()
app_1         |   File "/opt/miniconda/lib/python2.7/site-packages/django/utils/autoreload.py", line 249, in raise_last_exception
app_1         |     six.reraise(*_exception)
app_1         |   File "/opt/miniconda/lib/python2.7/site-packages/django/utils/autoreload.py", line 226, in wrapper
app_1         |     fn(*args, **kwargs)
app_1         |   File "/opt/miniconda/lib/python2.7/site-packages/django/__init__.py", line 18, in setup
app_1         |     apps.populate(settings.INSTALLED_APPS)
app_1         |   File "/opt/miniconda/lib/python2.7/site-packages/django/apps/registry.py", line 85, in populate
app_1         |     app_config = AppConfig.create(entry)
app_1         |   File "/opt/miniconda/lib/python2.7/site-packages/django/apps/config.py", line 123, in create
app_1         |     import_module(entry)
app_1         |   File "/opt/miniconda/lib/python2.7/importlib/__init__.py", line 37, in import_module
app_1         |     __import__(name)
app_1         |   File "/srv/src/sorl-thumbnail/sorl/thumbnail/__init__.py", line 1, in <module>
app_1         |     from sorl.thumbnail.fields import ImageField
app_1         |   File "/srv/src/sorl-thumbnail/sorl/thumbnail/fields.py", line 8, in <module>
app_1         |     from sorl.thumbnail import default
app_1         |   File "/srv/src/sorl-thumbnail/sorl/thumbnail/default.py", line 4, in <module>
app_1         |     from sorl.thumbnail.helpers import get_module_class
app_1         |   File "/srv/src/sorl-thumbnail/sorl/thumbnail/helpers.py", line 6, in <module>
app_1         |     from django.utils.importlib import import_module
app_1         | ImportError: No module named importlib

[thomasfillon]

Ok thank you Anas.

The error you get here may be related to dependencies that also need to be updated.
The upgrade to Django 1.9 from 1.6 has induced some changes in requirements and database migrations.

Here is the updgrade process from Telemeta with django 1.6.
This upgrade process is not fully validated yet and may cause damage in your current database. Please do not try this on your production database.

Upgrade process:

• Update git submodules (Timeside)
  • git submodule update --init --remote --recursive EDIT : this line is wrong ! --remote option should be remove. See coments at the bottom of this page
• Update Parisson base docker image and build:
  • docker pull parisson/timeside:latest-dev
  • docker-compose -f docker-compose.yml -f env/dev.yml build
• you also need to clear the existing Timeside Database (models have changed but it's safe for Telemeta models and database)
  - docker-compose -f docker-compose.yml -f env/dev.yml run app python manage.py migrate server zero
  - docker-compose -f docker-compose.yml -f env/dev.yml run app python manage.py migrate server
• When upgrading from Django 1.6, you also need to apply migrations for South to Django managed migrations:
  • docker-compose -f docker-compose.yml -f env/dev.yml run app python manage.py migrate --fake-initial
• At least, launch the Telemeta server:
  • docker-compose -f docker-compose.yml -f env/dev.yml up

[thomasfillon]

Any feedback on this upgrading process would really be appreciate. Thanks !

[thomasfillon]

Regarding the current status of the feature/django1.9 branch, there are some issues regarding the url namespace. Actually, all telemeta views need to be declare with the telemeta namespace in urls.py otherwise django can not match the view and the url patterns.
I suspect that some old fashioned views and some ad-hoc code function need to be rewritten to match modern Django framework but this still need to be checked with @yomguy

[AnasGhrab]

@thomasfillon

Zeus:Telemeta anas$ docker pull parisson/timeside:latest-dev
latest-dev: Pulling from parisson/timeside
386a066cd84a: Pull complete
68989880852f: Pull complete
c3a49a41ac92: Downloading [==========================================>        ]   226 MB/262.9 MB
d368507f091c: Download complete
40755864c98c: Download complete
182ac96e3309: Downloading [=============================>                     ] 193.5 MB/327.5 MB
ccd9ea92fe80: Download complete
d03f5a65d185: Download complete
d778cc8643cd: Download complete
ebfc56a85b71: Download complete
4d100610606b: Download complete
27825bd0117c: Download complete
72d898042580: Download complete
05c1552f3ea6: Download complete
117728e24899: Downloading
0a944d4954df: Waiting
74052b58e94a: Waiting
81a505d21a6d: Waiting
7fd109020c94: Waiting
f47b453c2c1c: Waiting
4998d8090344: Waiting
634f4084cc26: Waiting
unauthorized: authentication required

[thomasfillon]

You should retry because there is no authentification requirement I know about for accessing this public docker image ...

see https://hub.docker.com/r/parisson/timeside/builds/bqaecruv2zpsmc5qizi3ttg/

[AnasGhrab]

Zeus:Telemeta anas$ docker-compose -f docker-compose.yml -f env/dev.yml run app python manage.py migrate server zero
Starting telemeta_data_1
/srv/src/telemeta/telemeta/models/fields.py:124: RemovedInDjango110Warning: SubfieldBase has been deprecated. Use Field.from_db_value instead.
  class DurationField(models.Field):

/opt/miniconda/lib/python2.7/site-packages/matplotlib/font_manager.py:273: UserWarning: Matplotlib is building the font cache using fc-list. This may take a moment.
  warnings.warn('Matplotlib is building the font cache using fc-list. This may take a moment.')

('timeside.plugins.diadems.irit_speech_4hz', None)
Traceback (most recent call last):
  File "manage.py", line 7, in <module>
    execute_from_command_line(sys.argv)
  File "/opt/miniconda/lib/python2.7/site-packages/django/core/management/__init__.py", line 353, in execute_from_command_line
    utility.execute()
  File "/opt/miniconda/lib/python2.7/site-packages/django/core/management/__init__.py", line 327, in execute
    django.setup()
  File "/opt/miniconda/lib/python2.7/site-packages/django/__init__.py", line 18, in setup
    apps.populate(settings.INSTALLED_APPS)
  File "/opt/miniconda/lib/python2.7/site-packages/django/apps/registry.py", line 108, in populate
    app_config.import_models(all_models)
  File "/opt/miniconda/lib/python2.7/site-packages/django/apps/config.py", line 202, in import_models
    self.models_module = import_module(models_module_name)
  File "/opt/miniconda/lib/python2.7/importlib/__init__.py", line 37, in import_module
    __import__(name)
  File "/srv/src/timeside/timeside/server/models.py", line 31, in <module>
    import timeside.core
  File "/srv/src/timeside/timeside/core/__init__.py", line 45, in <module>
    ts_package.discover_modules('plugins', 'timeside')#__name__)
  File "/srv/src/timeside/timeside/core/tools/package.py", line 44, in discover_modules
    in pkgutil.walk_packages(pkg_path, pkg_prefix)]
  File "/srv/src/timeside/timeside/core/tools/package.py", line 81, in import_module_with_exceptions
    raise e
ImportError: cannot import name store_parameters

[thomasfillon]

It seems that there is some problems regarding the git submodules and especially about the version of the Timeside-Diadems one.

I will try this on a fresh install to fully understand what happens.

@AnasGhrab Did you start from a brand new directory ?