In T13298#233444, @jackyalcine wrote:To be honest, this is something I wanted to contribute. I've had moments as I'd code that my computer would lock up and it was because baloo was indexing pictures (not even the source code). I'm not sure but it's not explicit that Baloo runs only when the computer is idle. I'd want to extend this to communicate:
- How much time / progress is made for a full index
- Queries
- All Stories
- Search
- Advanced Search
Feed Advanced Search
Advanced Search
Advanced Search
Jun 20 2020
Jun 20 2020
hurikhan77 updated the task description for T11859: Understanding and reducing bad performance impact of running Baloo under certain conditions.
hurikhan77 updated the task description for T11859: Understanding and reducing bad performance impact of running Baloo under certain conditions.
Jun 18 2020
Jun 18 2020
Oct 12 2019
Oct 12 2019
hurikhan77 added a comment to T11861: Proposal: How to solve the 64-bit DocId conflict between ino and st_dev.
We need a unique identifier per inode namespace, and for btrfs this is per subvolume and not per disk. Currently, baloo uses QStorageInfo to obtain what it needs. I'll look into Solid and udisks but I fear they will be per disk only, too.
I don't think Baloo should store an index right on the filesystem it's going to index just to get rid of the device id. It seems tempting but I can think of multiple problems:
hurikhan77 updated the task description for T11859: Understanding and reducing bad performance impact of running Baloo under certain conditions.
hurikhan77 updated the task description for T11861: Proposal: How to solve the 64-bit DocId conflict between ino and st_dev.
hurikhan77 added a comment to T11861: Proposal: How to solve the 64-bit DocId conflict between ino and st_dev.
Looks like looking up the FS UUID can only be done by root (it involves libblkid reading the superblock directly). Does the kernel have some syscall to look that up, or why doesn't it? Also, st_dev is not stable on btrfs (and many other FSes that use virtual devices).
Oct 11 2019
Oct 11 2019
hurikhan77 updated the task description for T11859: Understanding and reducing bad performance impact of running Baloo under certain conditions.
hurikhan77 updated the task description for T11859: Understanding and reducing bad performance impact of running Baloo under certain conditions.
hurikhan77 renamed T11859: Understanding and reducing bad performance impact of running Baloo under certain conditions from Reduce bad performance impact of running Baloo under certain conditions to Understanding and reducing bad performance impact of running Baloo under certain conditions.
hurikhan77 updated the task description for T11859: Understanding and reducing bad performance impact of running Baloo under certain conditions.
hurikhan77 updated the task description for T11859: Understanding and reducing bad performance impact of running Baloo under certain conditions.
hurikhan77 updated the task description for T11859: Understanding and reducing bad performance impact of running Baloo under certain conditions.
This is a test notification, sent at Fri, Oct 11, 19:21.
Added depend line according to arc docs
Resend diff with arc
Using single-patch-per-branch approach
Now arc squashed all my commits into one single diff... I'm not sure if I like that.
Rebase and submit with arc
In D24539#545019, @ngraham wrote:This doesn't apply cleanly on master. Can you rebase it?
Oct 10 2019
Oct 10 2019
hurikhan77 added a dependent revision for D24539: [Database] Rework handling environment flags: D24540: [Database] Disable read-ahead to reduce thrashing.
My submission didn't work as expected...
Prevent filesystem thrashing in low-mem situations by turning off
read-ahead. Access patterns of baloo are unlikely to benefit from
read-ahead and preserving cache is more valuable than reading ahead
potentially unused data.
Oct 9 2019
Oct 9 2019
Let's close this in favor of D24502
Oct 8 2019
Oct 8 2019
I think we can also assume that using possibly unlimited recursion is also not good practice.