int() argument must be a string, a bytes-like object or a real number, not 'NoneType' while accessing pagination related attributes #1686

Activity

1. JohnVillalovos commented on Nov 10, 2021

   

   JohnVillalovos

   on Nov 10, 2021

   Member

   More actions

   I can't reproduce this but I only have about 90 projects.

   You might try doing:

   gl.enable_debug()
   

   As it might help diagnose the issue.
2. JohnVillalovos commented on Nov 10, 2021

   

   JohnVillalovos

   on Nov 10, 2021

   Member

   More actions

   Also if you can paste the full Exception stack trace it would be helpful to see what part of the code is triggering the issue.
3. nejch commented on Nov 10, 2021

   

   nejch

   on Nov 10, 2021

   Member

   More actions

   I think this is a duplicate of #1506 and maybe #1114, that gitlab.com keyset pagination thing again :(
4. VenkatsQuest commented on Nov 10, 2021

   

   VenkatsQuest

   on Nov 10, 2021

   Author

   More actions

   Also , related to pagination i do have specific question.

   Can we implement pagination in such way that , calling the required page number ( say for example 3 will return me the 3rd page ) ,

   current implementation is that i need to be in the same method , iterate through page 1 , page 2 and page 3. as long as i'm in the same function all is good.

   But if i leave this function , and come back to this pagination fuction with next_page number , Is this something possible ? Atleast i could not find it in the code examples.

   if you guys , have some ideas , please post it here. Appreciate your support.

   I'm more than willing to do code changes as well , if you point me the right souce location. Thanks much.
5. kenzliang commented on Dec 22, 2021

   

   kenzliang

   on Dec 22, 2021

   More actions

   +1 on this issue, debug log below. Can't seem to fetch the total pages. Seems sometimes Gitlab will not return the header X-total-pages.

   python-gitlab version:2.10.1
   API version you are using (v3/v4): v4
   Gitlab server version (or gitlab.com):13.12.12

   send: b'GET /api/v4/projects/112 HTTP/1.1\r\nHost: <gitlab.private.url>\r\nUser-Agent: python-gitlab/2.10.1\r\nAccept-Encoding: gzip, deflate\r\nAccept: */*\r\nConnection: keep-alive\r\nPRIVATE-TOKEN: private_token\r\nContent-type: application/json\r\n\r\n'
   reply: 'HTTP/1.1 200 OK\r\n'
   header: Cache-Control: max-age=0, private, must-revalidate
   header: Content-Encoding: gzip
   header: Content-Type: application/json
   header: Date: Wed, 22 Dec 2021 17:40:02 GMT
   header: Etag: W/"aeeab9b1b4fe9256fb52a73786e6b849"
   header: Referrer-Policy: strict-origin-when-cross-origin
   header: Server: nginx
   header: Strict-Transport-Security: max-age=31536000
   header: Vary: Accept-Encoding
   header: Vary: Origin
   header: X-Content-Type-Options: nosniff
   header: X-Frame-Options: SAMEORIGIN
   header: X-Gitlab-Feature-Category: projects
   header: X-Request-Id: 01FQHKN125FFCY3RACSDX2EKPS
   header: X-Runtime: 0.065188
   header: Content-Length: 1398
   header: Connection: keep-alive
   DEBUG:urllib3.connectionpool:https://<gitlab.private.url>:443 "GET /api/v4/projects/112 HTTP/1.1" 200 1398
   send: b'GET /api/v4/projects/112/repository/commits?since=2021-01-01+00%3A00%3A00&ref_name=master&per_page=100 HTTP/1.1\r\nHost: <gitlab.private.url>\r\nUser-Agent: python-gitlab/2.10.1\r\nAccept-Encoding: gzip, deflate\r\nAccept: */*\r\nConnection: keep-alive\r\nPRIVATE-TOKEN: private_token\r\nContent-type: application/json\r\n\r\n'
   reply: 'HTTP/1.1 200 OK\r\n'
   header: Cache-Control: max-age=0, private, must-revalidate
   header: Content-Encoding: gzip
   header: Content-Type: application/json
   header: Date: Wed, 22 Dec 2021 17:40:03 GMT
   header: Etag: W/"84a9393b2e899b627491c499a48ca92b"
   header: Link: <https://<gitlab.private.url>/api/v4/projects/112/repository/commits?id=112&order=default&page=2&per_page=100&ref_name=master&since=2021-01-01T00%3A00%3A00%2B00%3A00>; rel="next", <https://<gitlab.private.url>/api/v4/projects/112/repository/commits?id=112&order=default&page=1&per_page=100&ref_name=master&since=2021-01-01T00%3A00%3A00%2B00%3A00>; rel="first", <https://<gitlab.private.url>/api/v4/projects/112/repository/commits?id=112&order=default&page=2&per_page=100&ref_name=master&since=2021-01-01T00%3A00%3A00%2B00%3A00>; rel="last"
   header: Referrer-Policy: strict-origin-when-cross-origin
   header: Server: nginx
   header: Strict-Transport-Security: max-age=31536000
   header: Vary: Accept-Encoding
   header: Vary: Origin
   header: X-Content-Type-Options: nosniff
   header: X-Frame-Options: SAMEORIGIN
   header: X-Gitlab-Feature-Category: source_code_management
   header: X-Next-Page: 2
   header: X-Page: 1
   header: X-Per-Page: 100
   header: X-Prev-Page: 
   header: X-Request-Id: 01FQHKN17NPZMT9XGVAHH1QAXX
   header: X-Runtime: 0.065319
   header: Content-Length: 12033
   header: Connection: keep-alive
   DEBUG:urllib3.connectionpool:https://<gitlab.private.url>:443 "GET /api/v4/projects/112/repository/commits?since=2021-01-01+00%3A00%3A00&ref_name=master&per_page=100 HTTP/1.1" 200 12033
   Traceback (most recent call last):
     File "python_gitlab.py", line 83, in <module>
       get_repo_merges(SESSION, r_id,r_name)
     File "python_gitlab.py", line 32, in get_repo_merges
       print(commits.total)
     File "python/lib/python3.9/site-packages/gitlab/base.py", line 259, in total
       return self._list.total
     File "python/lib/python3.9/site-packages/gitlab/client.py", line 963, in total
       return int(self._total)
   

   👍React with 👍1Reacted by John Villalovos
6. kenzliang commented on Dec 22, 2021

   

   kenzliang

   on Dec 22, 2021

   More actions

   seems to be the issue here:
   https://docs.gitlab.com/ee/user/gitlab_com/index.html#pagination-response-headers

   👍React with 👍1Reacted by John Villalovos
7. JohnVillalovos

   added a commit that references this issue on Dec 22, 2021

   fix: handle situation where gitlab.com does not return values

   ...

   This issue will close once commit c79e061 is merged into the 'main' branch.

   c79e061
8. JohnVillalovos commented on Dec 22, 2021

   

   JohnVillalovos

   on Dec 22, 2021

   Member

   More actions

   +1 on this issue, debug log below. Can't seem to fetch the total pages. Seems sometimes Gitlab will not return the header X-total-pages.

   Thank you very much for the debug log and the link. That made it easy to figure out the issue. I have proposed a PR to resolve the issue.
9. JohnVillalovos

   self-assigned this

   on Dec 22, 2021
10. JohnVillalovos

    added 7 commits that reference this issue on Dec 22, 2021

    fix: handle situation where GitLab does not return values

    ...

    This issue will close once commit ca2e8e0 is merged into the 'main' branch.

    ca2e8e0

    fix: handle situation where GitLab does not return values

    ...

    This issue will close once commit 971a617 is merged into the 'main' branch.

    971a617

    fix: handle situation where GitLab does not return values

    ...

    This issue will close once commit 4690dc2 is merged into the 'main' branch.

    4690dc2

    fix: handle situation where GitLab does not return values

    ...

    This issue will close once commit 4a17937 is merged into the 'main' branch.

    4a17937

    fix: handle situation where GitLab does not return values

    ...

    This issue will close once commit c308c30 is merged into the 'main' branch.

    c308c30

    fix: handle situation where GitLab does not return values

    ...

    This issue will close once commit 4947901 is merged into the 'main' branch.

    4947901

    fix: handle situation where GitLab does not return values

    ...

    This issue will close once commit cb824a4 is merged into the 'main' branch.

    cb824a4
11. nejch

    closed this as completedin #1773on Dec 31, 2021
12. github-actions

    locked as resolved and limited conversation to collaborators on Jan 2, 2023