Threads in VFS
When VFS read the files of a folder, what number of threads it create?
Is a constant?
I put 300 files of a 1 MB and the ESB trought a heap error.
INFO: I put the heap at 1.600M
Bookmark/Search this post with:
- Login or register to post comments
- Printer friendly version
- 229 reads
Now I see the logs, 150
Now I see the logs, 150 files and the ESB open 150 threads.
Can I configure that?
It creates a separate thread
It creates a separate thread to process each "file" it sees as a "message". So when processing a Zip file that contains 100 XML files in it, that would be processed over 100 threads as of right now
If you are processing multiple files concurrently, you may want to tune your heap memory using the Java "-Xms" and "-Xmx" parameters, or pin file based proxy services to different instances running on a cluster
asankha
I would to processes the
I would to processes the files 1 to 1, or if I put 150 files processes 50, 50, 50. But not 150.
I tune the Xms and the Xmx but do a error of heap if I put more files.
I would to put a maxium number of threads.
Agreed that we can improve
Agreed that we can improve the logic used here.. can you raise a JIRA and we will re-evaluate options and enhance this
asankha
Hit by same issue as we have
Hit by same issue as we have a lot of file exchange and transformation at a particular time of the day. Are we able to do some throttling instance wide to specify that only a number of files can be processed at a given time?
Please raise a JIRA and we
Please raise a JIRA and we will make this enhancement as soon as possible
asankha