Skip to content

DB file size limit #114

Closed
Closed

Description

@serden84

Software works very fine with <1GB files, but I have one sqlite, which is 8.6GB and can't open. The question is: is there any limit of sqlite file size? Do you have experience with large files?

Activity

  1. justinclift commented on Sep 25, 2014

    @justinclift
    Member

    This may be related to #107.

    Unsure how to approach this though for such large file sizes.

  2. justinclift commented on Sep 25, 2014

    @justinclift
    Member

    Does the command line version of sqlite open this database ok?

  3. Z4us commented on Sep 26, 2014

    @Z4us
  4. rp- commented on Sep 26, 2014

    @rp-
    Contributor

    if the command line utility can open it, I see no real reason why sqlitebrowser shouldn't be able to.
    Until of course there is some sort of bug or we run out of memory while we generate additional table information

    But for example the row size shouldn't really hit us, as since 3.0 we added partial table retrieve to not fill up the memory with huge tables.

  5. justinclift commented on Nov 2, 2014

    @justinclift
    Member

    @serden84 Is this still being a problem for you?

    If so, would you have time to try opening the database file with the command line client, to see if that works?

  6. renkun-ken commented on Dec 8, 2014

    @renkun-ken

    I have a bunch of data-sets each larger than 1G plus a big one (50G). I tried SQLite Expert and it opens them and scans the data very quickly. So there should be no limit on this I think.

  7. justinclift commented on Apr 30, 2015

    @justinclift
    Member

    @serden84 @renkun-ken Our new release from a few days ago has a 64-bit Windows build. Would you have a few minutes to try it out with your larger data set files?

        https://github.com/sqlitebrowser/sqlitebrowser/releases/tag/v3.6.0

    We're hoping the 64-bit builds work better for large data sets now... 😄

  8. ogloo commented on Jul 14, 2015

    @ogloo

    I run SQLite Version 3.8.10.2 (Qt Version 5.4.1) on windows

    I confirm that the software is very slow for files above 200 Mo and crashes when the file exceeds 1 GB.

    It would be great if files that do more than 1GB where supported, but at least sqlite should warn the user at start that opening files of more than 1 GB can crash the software.

  9. justinclift commented on Jul 14, 2015

    @justinclift
    Member

    @ogloo Would you be ok to try our recent (3.7.0) release? The 64-bit version that is. In theory, it should open larger database files without a problem: 😄

        https://github.com/sqlitebrowser/sqlitebrowser/releases/tag/v3.7.0

  10. ogloo commented on Jul 15, 2015

    @ogloo

    I use the 32 bit version actually but it is the latest one 3.7.0.

  11. ogloo commented on Jul 15, 2015

    @ogloo

    And by the way in the SQL shell it would be great to have the number of affeted row when you do an update request, Some thing like:

    Query executed successfully: UPDATE table SET field = 's' WHERE field2 = 1
    (took 81ms, 5 rows affected)

  12. justinclift commented on Jul 16, 2015

    @justinclift
    Member

    The 32 bit version is unlikely to ever load large database files. To load large ones, you must use the 64 bit version. And yeah, I understand that might not be easy. 😦

  13. ogloo commented on Jul 16, 2015

    @ogloo

    So i'll deal with it but thank you for the answers.

  14. justinclift commented on Jul 16, 2015

    @justinclift
    Member

    Closing this as we introduced large database support on Windows with version 3.6.0 64-bit.

  15. MKleusberg commented on Jul 16, 2015

    @MKleusberg
    Member

    Yes, the 64 bit version sounds like the right approach here.

    But let's not forget the 'x rows affected' thing @ogloo mentioned above as this makes a lot of sense (even though it's a bit off topic in this issue 😃 ). With the latest commit I've just added this feature. Now, it's a bit awkward to say but it'll be available in the next nightly build which - unfortunately - is only available as a 32bit executable...

  16. justinclift commented on Jul 16, 2015

    @justinclift
    Member

    @MKleusberg Good catch. 😄

    @ogloo Would you be ok to try tomorrow's nightly build, and let us know if the new UPDATE output is working well for you? (download locations are on the front page of this repo if that helps)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions