Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Quick start guide missing configuration #625

Open
dicarcab opened this issue Jan 8, 2025 · 3 comments
Open

Quick start guide missing configuration #625

dicarcab opened this issue Jan 8, 2025 · 3 comments
Labels
bug Something isn't working

Comments

@dicarcab
Copy link

dicarcab commented Jan 8, 2025

Describe the bug

Hello, I've trying to test Polaris locally using the official Docker Image and a local gradle build, but have and issue while writing data to a catalog using S3.

I followed the Quick start guide and everything works fine until I tried to insert data to the table but I kept getting this answer
Server error: S3Exception: The bucket you are attempting to access must be addressed using the specified endpoint. Please send all future requests to this endpoint. (Service: S3, Status Code: 301,) is there any configuration that must be specified to the docker image to be able to write data to the desired location ?

I set up the aws access and secret key and my bucket is in the same region that is used in the docker compose image. Is there missing steps in the official documentation ?

To Reproduce

  1. set aws AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEYas env variables, AWS_REGION is set as us-west-2 inside docker file as the S3 bucket to be used.
  2. Follow the quick start guide create roles and catalog using the docker compose file inside polaris repo
  3. start local spark 3.5
  4. use catalog and create namespaces and table using spark sql
  5. using spark sql spark.sql("INSERT INTO quickstart_table VALUES (1, 'some data')") command

Actual Behavior

error returned by the rest api Server error: S3Exception: The bucket you are attempting to access must be addressed using the specified endpoint. Please send all future requests to this endpoint. (Service: S3, Status Code: 301,) is there any configuration that must be specified to the docker image to be able to write data to the desired location ?

Expected Behavior

Data should be written in the table

Additional context

No response

System information

WSL ubuntu, S3 as backend

@dicarcab dicarcab added the bug Something isn't working label Jan 8, 2025
@MonkeyCanCode
Copy link
Contributor

@dicarcab I think you will need to set AWS region as well depends on your setup. Maybe provide a bit more info on how to reproduce this?

@dicarcab
Copy link
Author

dicarcab commented Jan 9, 2025

@MonkeyCanCode I updated the steps to reproduce the issue. The bucket is located in us-west-2 region as the default value inside the docker compose file.

@MonkeyCanCode
Copy link
Contributor

@MonkeyCanCode I updated the steps to reproduce the issue. The bucket is located in us-west-2 region as the default value inside the docker compose file.

K. I will take a look later this weekend then update. I recalled this part used to work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants