0001109: Kdenlive can't load more than 100 clips

(0003862)
j-b-m (administrator)
2009-09-05 09:08

I tried to reproduce with 107 small hdv video clips but no crash...
One question: do you have the "show audio thumbails" feature enabled? (small sound button in the status bar). If yes, could you try with audio thumbs disabled to see if it also crashes?

(0003866)
src (reporter)
2009-09-06 13:04

I tried to disable both video and audio thumbs, but it is still the same.

(0003890)
j-b-m (administrator)
2009-09-14 18:43

Could you please try to update to latest svn (rev 3890) to see if the issue is fixed (I reworked a bit the clip loading stuff)...

(0003895)
src (reporter)
2009-09-15 19:20

Sorry, not fixed. Crash log attached.

(0003908)
ddennedy (developer)
2009-09-16 07:43

How many cores (real + virtual) are on your system? The builder wizard's launch script gets the number of cpus from /proc and instructs MLT to use N-1 decoding threads. On a multi-core system and with many files you could exhaust the maximum number of threads per process. Edit your kdenlive_start.sh script, comment out the line that sets the number of CPUs or the MLT_AVFORMAT_THREADS environment variable, and see if you can load more files.

(0003944)
src (reporter)
2009-09-17 00:15

I have 3 cores. I commented out MLT_AVFORMAT_THREADS, but it still crashes, although with less threads and in slightly different place - see attached crash log.

(0003949)
ddennedy (developer)
2009-09-17 01:51

See if melt plays them in a terminal window. Something like:

$ melt -verbose *.dv

Do you think it may be failing on a specific file instead of the number of files? IOW, If it seems to be failing at file "100" move "100" out of the way and try again.

(0003950)
ddennedy (developer)
2009-09-17 02:05

Changing from block to crash because "block" implies it should be top priority and block the next release, and it is not that important for me. Not that many people use hundreds of files - heck, most of them will not have the patience to wait for loading a project with that many files.

(0004010)
src (reporter)
2009-09-26 20:27
edited on: 2009-09-26 20:27

Tried melt and also kdenlive again and it crashes regardless of the file. Now it crashes if there is more than cca 520 files.

(0004011)
ddennedy (developer)
2009-09-26 21:23

Sorry, but your last comment is terse. Does "it crashes regardless of the file" mean you do not think a particular file in the set is causing a problem? Rather, it is stricly the number of files?

Are you saying that now, not just in melt, but also Kdenlive you can reliably load 500 files? Are you testing just the Project tree or the timeline as well?

If so, I consider a satisfactory resolution to prevent a crash is to limit you to adding no more than 500 files. Then, you can file a feature request for support of unlimited number of files.

(0004012)
src (reporter)
2009-09-26 21:32

Yes, I do not think that a particular file is causing a problem, it is just a number. And I am testing just a project tree, not the timeline.

I guess I could live with the limitation although it would mean to work with Kdenlive only in a later stages of cutting process (my projects normally have 600-700 clips). But 500 is better than 100. Thank you for your help.

Issue History
Date Modified	Username	Field	Change
2009-08-30 12:14	src	New Issue
2009-08-30 12:14	src	File Added: gdb.report.txt
2009-08-30 12:14	src	Build/Install Method	=> Build Wizard
2009-09-02 15:37	Granjow	Relationship added	has duplicate 0001108
2009-09-05 09:08	j-b-m	Note Added: 0003862
2009-09-05 09:08	j-b-m	Status	new => feedback
2009-09-06 13:04	src	Note Added: 0003866
2009-09-14 08:42	j-b-m	Summary	Kdenlive can't load more than 0000051:0000100 clips => Kdenlive can't load more than 100 clips
2009-09-14 08:42	j-b-m	Relationship added	has duplicate 0001131
2009-09-14 18:43	j-b-m	Note Added: 0003890
2009-09-15 19:20	src	File Added: gdb.report2.txt
2009-09-15 19:20	src	Note Added: 0003895
2009-09-16 07:43	ddennedy	Note Added: 0003908
2009-09-17 00:15	src	Note Added: 0003944
2009-09-17 00:16	src	File Added: gdb.report3.txt
2009-09-17 01:51	ddennedy	Note Added: 0003949
2009-09-17 02:05	ddennedy	Note Added: 0003950
2009-09-17 02:05	ddennedy	Severity	block => crash
2009-09-26 20:27	src	Note Added: 0004010
2009-09-26 20:27	src	Note Edited: 0004010	View Revisions
2009-09-26 21:23	ddennedy	Note Added: 0004011
2009-09-26 21:32	src	Note Added: 0004012

Notes
(0003862) j-b-m (administrator) 2009-09-05 09:08	I tried to reproduce with 107 small hdv video clips but no crash... One question: do you have the "show audio thumbails" feature enabled? (small sound button in the status bar). If yes, could you try with audio thumbs disabled to see if it also crashes?

(0003866) src (reporter) 2009-09-06 13:04	I tried to disable both video and audio thumbs, but it is still the same.

(0003890) j-b-m (administrator) 2009-09-14 18:43	Could you please try to update to latest svn (rev 3890) to see if the issue is fixed (I reworked a bit the clip loading stuff)...

(0003895) src (reporter) 2009-09-15 19:20	Sorry, not fixed. Crash log attached.

(0003908) ddennedy (developer) 2009-09-16 07:43	How many cores (real + virtual) are on your system? The builder wizard's launch script gets the number of cpus from /proc and instructs MLT to use N-1 decoding threads. On a multi-core system and with many files you could exhaust the maximum number of threads per process. Edit your kdenlive_start.sh script, comment out the line that sets the number of CPUs or the MLT_AVFORMAT_THREADS environment variable, and see if you can load more files.

(0003944) src (reporter) 2009-09-17 00:15	I have 3 cores. I commented out MLT_AVFORMAT_THREADS, but it still crashes, although with less threads and in slightly different place - see attached crash log.

(0003949) ddennedy (developer) 2009-09-17 01:51	See if melt plays them in a terminal window. Something like: $ melt -verbose *.dv Do you think it may be failing on a specific file instead of the number of files? IOW, If it seems to be failing at file "100" move "100" out of the way and try again.

(0003950) ddennedy (developer) 2009-09-17 02:05	Changing from block to crash because "block" implies it should be top priority and block the next release, and it is not that important for me. Not that many people use hundreds of files - heck, most of them will not have the patience to wait for loading a project with that many files.

(0004010) src (reporter) 2009-09-26 20:27 edited on: 2009-09-26 20:27	Tried melt and also kdenlive again and it crashes regardless of the file. Now it crashes if there is more than cca 520 files.

(0004011) ddennedy (developer) 2009-09-26 21:23	Sorry, but your last comment is terse. Does "it crashes regardless of the file" mean you do not think a particular file in the set is causing a problem? Rather, it is stricly the number of files? Are you saying that now, not just in melt, but also Kdenlive you can reliably load 500 files? Are you testing just the Project tree or the timeline as well? If so, I consider a satisfactory resolution to prevent a crash is to limit you to adding no more than 500 files. Then, you can file a feature request for support of unlimited number of files.

(0004012) src (reporter) 2009-09-26 21:32	Yes, I do not think that a particular file is causing a problem, it is just a number. And I am testing just a project tree, not the timeline. I guess I could live with the limitation although it would mean to work with Kdenlive only in a later stages of cutting process (my projects normally have 600-700 clips). But 500 is better than 100. Thank you for your help.