Uploaded image for project: 'Hue (READ ONLY)'
  1. Hue (READ ONLY)
  2. HUE-4827

[fb] Pointing to a wrong S3 region breaks with no information

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.11.0
    • Fix Version/s: 3.12.0
    • Component/s: app.filebrowser
    • Labels:
      None
    • Target Version:
    • Sprint:
      Sept 6-23, 2016

      Description

      Just tried with:
      region=eu-central-1
      on us-east-1

      Then listing buckets is fine, but we can't open them (as not from the same region) but we don't show any error why and just crash.

      ValueError at /filebrowser/view=s3a://cloudera-hostdata
      <class 'boto.exception.S3ResponseError'>
      
      Request Method: GET
      Request URL: http://127.0.0.1:8000/filebrowser/view=s3a://cloudera-hostdata?pagesize=45&pagenum=1&filter=&sortby=name&descending=false&format=json
      Django Version: 1.6.10
      Python Executable: /home/romain/projects/hue/build/env/bin/python2.7
      Python Version: 2.7.6
      Python Path: ['/home/romain/projects/hue/build/env/bin', '/home/romain/projects/hue/apps/about/src', '/home/romain/projects/hue/apps/beeswax/gen-py', '/home/romain/projects/hue/apps/beeswax/src', '/home/romain/projects/hue/apps/filebrowser/src', '/home/romain/projects/hue/apps/hbase/gen-py', '/home/romain/projects/hue/apps/hbase/src', '/home/romain/projects/hue/apps/help/src', '/home/romain/projects/hue/apps/impala/gen-py', '/home/romain/projects/hue/apps/impala/src', '/home/romain/projects/hue/apps/jobbrowser/src', '/home/romain/projects/hue/apps/jobsub/src', '/home/romain/projects/hue/apps/metastore/src', '/home/romain/projects/hue/apps/oozie/src', '/home/romain/projects/hue/apps/pig/src', '/home/romain/projects/hue/apps/proxy/src', '/home/romain/projects/hue/apps/rdbms/src', '/home/romain/projects/hue/apps/search/src', '/home/romain/projects/hue/apps/security/src', '/home/romain/projects/hue/apps/spark/src', '/home/romain/projects/hue/apps/sqoop/src', '/home/romain/projects/hue/apps/useradmin/src', '/home/romain/projects/hue/apps/zookeeper/src', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/avro-1.7.6-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/Babel-0.9.6-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/BabelDjango-0.2.2-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/boto-2.42.0-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/cffi-1.5.2-py2.7-linux-x86_64.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/configobj-4.6.0-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/cryptography-1.3.1-py2.7-linux-x86_64.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/cx_Oracle-5.1.2-py2.7-linux-x86_64.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/django_auth_ldap-1.2.0-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/django_axes-1.5.0-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/django_extensions-1.5.0-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/django_nose-1.3-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/django_openid_auth-0.5-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/djangosaml2-0.13.0-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/elementtree-1.2.6.post20050316-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/enum-0.4.4-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/guppy-0.1.10-py2.7-linux-x86_64.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/httplib2-0.8-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/importlib-1.0.3-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/jdcal-1.0-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/kazoo-2.0-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/kerberos-1.1.1-py2.7-linux-x86_64.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/lockfile-0.8-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/lxml-3.3.6-py2.7-linux-x86_64.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/Mako-0.8.1-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/Markdown-2.0.3-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/MarkupSafe-0.9.3-py2.7-linux-x86_64.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/MySQL_python-1.2.5-py2.7-linux-x86_64.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/ndg_httpsclient-0.4.0-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/openpyxl-2.3.0b2-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/ordereddict-1.1-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/pam-0.1.3-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/parquet-1.0-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/Paste-2.0.1-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/py4j-0.9-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/pyasn1-0.1.8-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/pycparser-2.14-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/pycrypto-2.6.1-py2.7-linux-x86_64.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/pyformance-0.3.2-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/Pygments-1.3.1-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/pyOpenSSL-0.15.1-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/pysaml2-2.4.0-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/pysqlite-2.5.5-py2.7-linux-x86_64.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/python_daemon-1.5.1-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/python_dateutil-2.4.2-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/python_ldap-2.3.13-py2.7-linux-x86_64.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/oauth2-1.5.211-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/python_openid-2.2.5-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/pytidylib-0.2.1-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/pytz-2015.2-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/requests-2.10.0-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/requests_kerberos-0.6.1-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/sasl-0.1.1-py2.7-linux-x86_64.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/simplejson-2.0.9-py2.7-linux-x86_64.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/six-1.9.0-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/South-1.0.2-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/tablib-0.10.0-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/thrift-0.9.1-py2.7-linux-x86_64.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/urllib2_kerberos-0.1.6-py2.7.egg', '/home/romain/projects/hue/desktop/core/src', '/home/romain/projects/hue/desktop/libs/aws/src', '/home/romain/projects/hue/desktop/libs/hadoop/src', '/home/romain/projects/hue/desktop/libs/indexer/src', '/home/romain/projects/hue/desktop/libs/liboauth/src', '/home/romain/projects/hue/desktop/libs/liboozie/src', '/home/romain/projects/hue/desktop/libs/libopenid/src', '/home/romain/projects/hue/desktop/libs/librdbms/src', '/home/romain/projects/hue/desktop/libs/libsaml/src', '/home/romain/projects/hue/desktop/libs/libsentry/src', '/home/romain/projects/hue/desktop/libs/libsolr/src', '/home/romain/projects/hue/desktop/libs/libzookeeper/src', '/home/romain/projects/hue/desktop/libs/metadata/src', '/home/romain/projects/hue/desktop/libs/notebook/src', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/ipdb-0.1dev_r1716-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/ipython-0.10-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/nose-0.11.3-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/coverage-3.7.1-py2.7-linux-x86_64.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/nosetty-0.4-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/Werkzeug-0.6-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/windmill-1.3-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/pylint-0.28.0-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/logilab_astng-0.24.3-py2.7.egg', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/logilab_common-1.2.2-py2.7.egg', '/home/romain/projects/hue/build/env/lib/python2.7', '/home/romain/projects/hue/build/env/lib/python2.7/plat-x86_64-linux-gnu', '/home/romain/projects/hue/build/env/lib/python2.7/lib-tk', '/home/romain/projects/hue/build/env/lib/python2.7/lib-old', '/home/romain/projects/hue/build/env/lib/python2.7/lib-dynload', '/usr/lib/python2.7', '/usr/lib/python2.7/plat-x86_64-linux-gnu', '/usr/lib/python2.7/lib-tk', '/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages', '/usr/local/lib/python2.7/dist-packages/virtualenv-1.10.1-py2.7.egg', '/usr/local/lib/python2.7/site-packages', '/usr/local/lib/python2.7/dist-packages', '/usr/lib/python2.7/site-packages', '/usr/lib/python2.7/dist-packages', '/usr/lib/python2.7/dist-packages/PILcompat', '/usr/lib/python2.7/dist-packages/gtk-2.0', '/usr/lib/python2.7/dist-packages/ubuntu-sso-client', '/home/romain/projects/hue/desktop/libs/libsentry/src/libsentry/../../gen-py', '/home/romain/projects/hue/apps/beeswax/src/beeswax/../../gen-py', '/home/romain/projects/hue/apps/hbase/src/hbase/../../gen-py', '/home/romain/projects/hue/apps/impala/src/impala/../../gen-py', '/home/romain/projects/hue/apps/jobbrowser/src/jobbrowser/../../gen-py', '/home/romain/projects/hue/apps/proxy/src/proxy/../../gen-py']
      Server time: Fri, 9 Sep 2016 14:34:49 -0700
      Installed Applications:
      ['django.contrib.auth',
       'django_openid_auth',
       'django.contrib.contenttypes',
       'django.contrib.sessions',
       'django.contrib.sites',
       'django.contrib.staticfiles',
       'django.contrib.admin',
       'django_extensions',
       'south',
       'babeldjango',
       'desktop',
       'axes',
       'about',
       'beeswax',
       'filebrowser',
       'hbase',
       'help',
       'impala',
       'jobbrowser',
       'jobsub',
       'metastore',
       'oozie',
       'pig',
       'proxy',
       'rdbms',
       'search',
       'security',
       'spark',
       'sqoop',
       'useradmin',
       'zookeeper',
       'indexer',
       'metadata',
       'notebook']
      Installed Middleware:
      ['desktop.middleware.MetricsMiddleware',
       'desktop.middleware.EnsureSafeMethodMiddleware',
       'desktop.middleware.AuditLoggingMiddleware',
       'django.middleware.common.CommonMiddleware',
       'django.contrib.sessions.middleware.SessionMiddleware',
       'django.contrib.auth.middleware.AuthenticationMiddleware',
       'desktop.middleware.SpnegoMiddleware',
       'desktop.middleware.HueRemoteUserMiddleware',
       'django.middleware.locale.LocaleMiddleware',
       'babeldjango.middleware.LocaleMiddleware',
       'desktop.middleware.AjaxMiddleware',
       'django.middleware.security.SecurityMiddleware',
       'django.middleware.clickjacking.XFrameOptionsMiddleware',
       'desktop.middleware.ContentSecurityPolicyMiddleware',
       'desktop.middleware.LoginAndPermissionMiddleware',
       'django.contrib.messages.middleware.MessageMiddleware',
       'desktop.middleware.NotificationMiddleware',
       'desktop.middleware.ExceptionMiddleware',
       'desktop.middleware.ClusterMiddleware',
       'django.middleware.csrf.CsrfViewMiddleware',
       'django.middleware.http.ConditionalGetMiddleware',
       'axes.middleware.FailedLoginMiddleware',
       'desktop.middleware.EnsureSafeRedirectURLMiddleware',
       'useradmin.middleware.LastActivityMiddleware']
      
      Traceback:
      File "/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/core/handlers/base.py" in get_response
        112.                     response = wrapped_callback(request, *callback_args, **callback_kwargs)
      File "/home/romain/projects/hue/build/env/local/lib/python2.7/site-packages/Django-1.6.10-py2.7.egg/django/db/transaction.py" in inner
        371.                 return func(*args, **kwargs)
      File "/home/romain/projects/hue/apps/filebrowser/src/filebrowser/views.py" in view
        175.         stats = request.fs.stats(path)
      File "/home/romain/projects/hue/desktop/core/src/desktop/lib/fs/proxyfs.py" in stats
        102.     return self._get_fs(path).stats(path)
      File "/home/romain/projects/hue/desktop/libs/aws/src/aws/s3/__init__.py" in wrapped
        52.       return fn(*args, **kwargs)
      File "/home/romain/projects/hue/desktop/libs/aws/src/aws/s3/s3fs.py" in stats
        218.     stats = self._stats(path)
      File "/home/romain/projects/hue/desktop/libs/aws/src/aws/s3/s3fs.py" in _stats
        125.       key = self._get_key(path, validate=True)
      File "/home/romain/projects/hue/desktop/libs/aws/src/aws/s3/s3fs.py" in _get_key
        111.       raise ValueError(e)
      
      Exception Type: ValueError at /filebrowser/view=s3a://cloudera-hostdata
      Exception Value: <class 'boto.exception.S3ResponseError'>
      Request information:
      GET:
      pagenum = u'1'
      pagesize = u'45'
      format = u'json'
      filter = u''
      descending = u'false'
      sortby = u'name'
      
      POST: No POST data
      
      FILES: No FILES data
      
      COOKIES:
      

        Attachments

          Activity

            People

            • Assignee:
              jennykim Jenny Kim
              Reporter:
              romain Romain Rigaux
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: