Skip to content

Useless time consuming internal SQL-commands at start-up and at browsing data?? #503

Open

Description

@zwrmueller

Hello,

I observed, that just opening a big sqlite-file tooks lots of time. At the SQL_Log panel I could see that SQLitebrowser first queries the sql_temp_master table, which is ok for me, but then also automatically queries the first table inside the db file. Just to show me nothing else more than the entry panel with the file structure. I think the last query is pretty useless, cause switching to data panel issues the query for the first table again!

Second:
If then I will have a look at the data and right-click on the table of choice and clicking Browse Table then SQLitebrowser issues 2 queries: 1st) for the last table (looked at or automatically queried by program start) and 2nd) for the actual table I want to look at. Again I think the first query is pretty useless!?

Or do I miss a point?

Regards
Ralf

Activity

  1. changed the title [-]Useless timeconsuming internal SQL-commands??[/-] [+]Useless time consuming internal SQL-commands at start-up and at browsing data??[/+] on Jan 22, 2016
  2. justinclift commented on Jan 22, 2016

    @justinclift
    Member

    Hmmmm, yeah, you're probably right. It's kind of a semi-legacy code base, and we haven't really optimised things for working with large databases. It would be useful for someone to join the team who'd be interested in doing that.

    Would you happen to know anyone suitable and who might have the time/interest? 😀

  3. zwrmueller commented on Jan 22, 2016

    @zwrmueller
    Author

    Hello Justin,

    we were on this before, unfortunately not. I can only offer my interest in beta testing/usability testing/reporting issues I stumble upon. But I’m not a programmer or know of anyone here.

    I’m sorry
    Ralf

  4. justinclift commented on Jan 22, 2016

    @justinclift
    Member

    No worries at all. I ask widely because sometimes it works out well. 😁

  5. MKleusberg commented on Jan 27, 2016

    @MKleusberg
    Member

    Both issues should be fixed in the next nightly build. Let's have a thorough test here because this required changing some of the more central parts of the UI code 😄

  6. justinclift commented on Jan 28, 2016

    @justinclift
    Member

    @zwrmueller Do you have time to test the next nightly build (tomorrow), and let us know if it's working better for you now? 😄

  7. zwrmueller commented on Jan 28, 2016

    @zwrmueller
    Author

    Sure, that’s the least that I can do.

    Regards
    Ralf

  8. zwrmueller commented on Jan 29, 2016

    @zwrmueller
    Author

    Hi, here is my testing:

    I’m on Windows 7 SP1, tests with actual nightly build from 29.01.2016:

    Issue 1) SQLiteBrowser now loads lightning fast – good!
    Issue 2) just clicking on the tab Browse Data results in incremental loadings of data in 50000 steps, which took looooooooong time - and finally crashed on a big data file, on small data file there is no crash; but the incremental loadings are not the behavior as before and pretty useless for a first glance at the file.

    I answer per mail and put screenshots into it – dunno if it makes it to the forum …

    Regards
    Ralf

  9. justinclift commented on Jan 30, 2016

    @justinclift
    Member

    Thanks Ralf. And yeah, email attachments don't get added to issues. They need to be added using the web interface. Would you be ok to do that? 😄

  10. zwrmueller commented on Jan 30, 2016

    @zwrmueller
    Author

    new startup - OK!

    err_sqlite_startup_new_ok

    was old startup - with immediate query - bad

    err_sqlite_startup_old_bad

    new BrowseData - with incremental data queries - bad

    err_sqlite_browsedata_new_bad

    new BrowseData - with crash on big data file

    err_sqlite_browsedata_new_crash

    old BrowseData - with double time useless SQL query - not optimal

    err_sqlite_browsedata_old_bad

    Regards
    Ralf

  11. justinclift commented on Jan 31, 2016

    @justinclift
    Member

    Thanks Ralf. 😄

  12. justinclift commented on May 26, 2018

    @justinclift
    Member

    @zwrmueller Any interesting in testing a build with (significant) performance enhancements for the Browse Data tab? If so, we've just chucked them up on the nightlies server:

    In my testing of a ~600MB database file, the lag time when using the Browse Data tab is now around 1 second. That's a lot better than it used to be. 😄

  13. mgrojo commented on Oct 5, 2018

    @mgrojo
    Member

    @zwrmueller The improvement that we mentioned is already available in our nightly builds and will be available in our next release. Would you mind confirming that the issue is fixed for you?

  14. chrisjlocke commented on Jan 8, 2019

    @chrisjlocke
    Member

    Hi @zwrmueller - just checking if you're still interested in checking one of our nightly builds?

  15. wmertens commented on Jan 15, 2019

    @wmertens

    One thing I noticed (still in latest nightly) is that sometimes, the browse data tab can be interrupted, but most of the time if the first query is a slow one it just hangs the UI.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions