在Kubernetes中找不到带有OAuth2身份验证404页面的Nginx Ingress

如何解决在Kubernetes中找不到带有OAuth2身份验证404页面的Nginx Ingress

在此link上，关于堆栈溢出的问题之后，在成功进行身份验证（在Github.com上）后，我在浏览器中找不到 404页面。

下面的Ingress配置（由nginx-ingress控制器使用）：

apiVersion: extensions/v1beta1
kind: Ingress
Metadata:
  name: ingress
  namespace: nginx-ingress
  annotations:
     Nginx.ingress.kubernetes.io/auth-url: "https://$host/oauth2/auth"
     Nginx.ingress.kubernetes.io/auth-signin: "https://$host/oauth2/start?rd=$request_uri"
spec:
  ingressClassName: Nginx
  rules:
  - host: site.example.com
    http:
      paths:
      - path: /v1                                               
        backend:
          serviceName: web-service
          servicePort: 8080
      - path: /
        backend:
          serviceName: oauth2-proxy
          servicePort: 4180
  tls:
  - hosts:
    - site.example.com
    secretName: example-tls

$ kubectl get ing -n nginx-ingress
  NAME      CLASS   HOSTS              ADDRESS   PORTS     
  ingress   Nginx   site.example.com             80,443

浏览器将GET发送到https://site.example.com/，
浏览器重定向到Github登录页面，
成功登录后，浏览器将重定向到https://site.example.com/，
浏览器发送GET到https://site.example.com/，其中已填充Cookie _oauth2_proxy
响应是 404页未找到

我尝试通过oauth2访问的node.js Web应用程序已使用两个路径（/和/ v1）构建。 Web应用程序位于服务 web-service 后面。

OAuth2 Github应用程序配置：

Homepage URL
https://site.example.com/

Authorization callback URL
https://site.example.com/oauth2/callback

OAuth2部署和服务：

apiVersion: apps/v1
kind: Deployment
Metadata:
  labels:
    k8s-app: oauth2-proxy
  name: oauth2-proxy
  namespace: nginx-ingress
spec:
  replicas: 1
  selector:
    matchLabels:
      k8s-app: oauth2-proxy
  template:
    Metadata:
      labels:
        k8s-app: oauth2-proxy
    spec:
      containers:
      - args:
        - --provider=github
        - --email-domain=*
        - --upstream=file:///dev/null
        - --http-address=0.0.0.0:4180
        # Register a new application
        # https://github.com/settings/applications/new
        env:
        - name: OAUTH2_PROXY_CLIENT_ID
          value: 32066******52
        - name: OAUTH2_PROXY_CLIENT_SECRET
          value: ff2b0a***************9bd
        - name: OAUTH2_PROXY_COOKIE_SECRET
          value: deSF_t******03-HQ==
        image: quay.io/oauth2-proxy/oauth2-proxy:latest
        imagePullPolicy: Always
        name: oauth2-proxy
        ports:
        - containerPort: 4180
          protocol: TCP

apiVersion: v1
kind: Service
Metadata:
  labels:
    k8s-app: oauth2-proxy
  name: oauth2-proxy
  namespace: nginx-ingress
spec:
  ports:
  - name: http
    port: 4180
    protocol: TCP
    targetPort: 4180
  selector:
    k8s-app: oauth2-proxy

来自oauth2-proxy容器的日志：

[2020/11/10 19:47:27] [logger.go:508] Error loading cookied session: cookie "_oauth2_proxy" not present,removing session
10.44.0.2:51854 - - [2020/11/10 19:47:27] site.example.com GET - "/" HTTP/1.1 "Mozilla/5.0
[2020/11/10 19:47:27] [logger.go:508] Error loading cookied session: cookie "_oauth2_proxy" not present,removing session
10.44.0.2:51858 - - [2020/11/10 19:47:27] site.example.com GET - "/favicon.ico" HTTP/1.1 "Mozilla/5.0 ....
10.44.0.2:51864 - - [2020/11/10 19:47:28] site.example.com GET - "/oauth2/start?rd=%2F" HTTP/1.1 "Mozilla/5.0 ....
10.44.0.2:52004 - marco.***81@gmail.com [2020/11/10 19:48:33] [AuthSuccess] Authenticated via OAuth2: Session{email:marco.***81@gmail.com user:mafi81 PreferredUsername: token:true created:2020-11-10 19:48:32.494549621 +0000 UTC m=+137.822819581}
10.44.0.2:52004 - - [2020/11/10 19:48:32] site.example.com GET - "/oauth2/callback?code=da9c3af9d8f35728d2d1&state=e3280edf2430c507cd74f3d4655500c1%3A%2F" HTTP/1.1 "Mozilla/5.0 ...
10.44.0.2:52012 - marco.****81@gmail.com [2020/11/10 19:48:33] site.example.com GET - "/" HTTP/1.1 "Mozilla/5.0 ....
10.44.0.2:52014 - marco.****81@gmail.com [2020/11/10 19:48:33] site.example.com GET - "/favicon.ico" HTTP/1.1 "Mozilla/5.0 .... Chrome/86.0.4240.193 Safari/537.36" 404 19 0.000

测试环境：

带有kubeadm v1.19.3的VirtualBox
Nginx入口控制器版本= 1.9.0。

我对Ingress资源下的路径配置仍然不满意。关于如何继续进行故障排除的任何建议都很好。

更新：

按照Matt的回答，提供测试身份验证的正确方法，这是新环境：

Nginx Ingress controller
  Release:       v0.41.2
  Build:         d8a93551e6e5798fc4af3eb910cef62ecddc8938
  Repository:    https://github.com/kubernetes/ingress-Nginx
  Nginx version: Nginx/1.19.4

OAuth2 Pod
  image: quay.io/oauth2-proxy/oauth2-proxy

入口清单：

apiVersion: extensions/v1beta1
kind: Ingress
Metadata:
  name: ingress
  namespace: web
  annotations:
     Nginx.ingress.kubernetes.io/auth-response-headers: Authorization
     Nginx.ingress.kubernetes.io/auth-url: http://oauth2-proxy.web.svc.cluster.local:4180/oauth2/auth
     Nginx.ingress.kubernetes.io/auth-signin: https://site.example.com/oauth2/start?rd=$request_uri
     Nginx.ingress.kubernetes.io/configuration-snippet: |
       auth_request_set $name_upstream_1 $upstream_cookie__oauth2_proxy_1;

       access_by_lua_block {
         if ngx.var.name_upstream_1 ~= "" then
           ngx.header["Set-Cookie"] = "_oauth2_proxy_1=" ..  ngx.var.name_upstream_1 .. ngx.var.auth_cookie:match("(; .*)")
         end
       }

spec:
  ingressClassName: Nginx-oauth
  rules:
  - host: site.example.com
    http:
      paths:
      - path: /
        backend:
          serviceName: web-service
          servicePort: 8080

apiVersion: networking.k8s.io/v1beta1
kind: Ingress
Metadata:
  name: oauth2-proxy
  namespace: web

spec:
  ingressClassName: Nginx-oauth

  rules:
  - host: site.example.com
    http:
      paths:
      - backend:
          serviceName: oauth2-proxy
          servicePort: 4180
        path: /oauth2

  tls:
  - hosts:
    - site.example.com
    secretName: tls

请注意，我必须更改一个注释才能使其正常工作：

auth-url：http：// oauth2- proxy.web.svc.cluster.local：4180 / oauth2 / auth（解决了解析失败）

解决方法

根据oauth-proxy documentation，您必须使用kubernetes/ingress-nginx。

在这里您可以了解有关differences between nginxinc/kubernetes-ingress and kubernetes/ingress-nginx Ingress Controllers的更多信息。

在oath2-proxy文档（前面提到）中，您可以找到以下内容：

在Kubernetes中使用ingress-nginx时，必须为Ingress使用kubernetes / ingress-nginx（包括Lua模块）和以下配置代码段。当通过proxy_pass处理位置时，使用auth_request_set设置的变量不能在纯nginx配置中设置，然后只能由Lua处理。请注意，nginxinc / kubernetes-ingress不包含Lua模块。
nginx.ingress.kubernetes.io/auth-response-headers: Authorization
nginx.ingress.kubernetes.io/auth-signin: https://$host/oauth2/start?rd=$escaped_request_uri
nginx.ingress.kubernetes.io/auth-url: https://$host/oauth2/auth
nginx.ingress.kubernetes.io/configuration-snippet: |
  auth_request_set $name_upstream_1 $upstream_cookie_name_1;

  access_by_lua_block {
    if ngx.var.name_upstream_1 ~= "" then
      ngx.header["Set-Cookie"] = "name_1=" .. ngx.var.name_upstream_1 .. ngx.var.auth_cookie:match("(; .*)")
    end
  }

因此，如果我们可以信任文档，则您的身份验证将无法进行，因为您使用的是错误的nginx控制器，并且缺少注释。