Uploading rather large files

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Uploading rather large files

Richard Carpenter-2
I have tested this with the following configurations :
 
Windows 2000 sp6 4D Server as web server
4D Server 6.7.4
QT 6 installed
 
Windows 2000 sp6 4D Client as web server
4D 6.5.8 on client
QT 6 Installed
 
IE clients on both mac and win.
ITK 2.5 for the web server.
 
In all cases A4D 2.0.5 was used.
 
------------------------------
 
When uploading a file over about 8.6G 'A4D Execute stream request ' from the A4D_ITK Server method returns a 400 Bad Request.
 
I have run a number of tests and am looking for more ideas to help track this problem down.  Here are the tests and quick results :
 
1.  Used the Active 4D Demo 4D Database to upload a 9G file.  This used the 4D Web Server.  File uploaded successfully.
 
2.  Converted A4D Demo database to use ITK.   Uploaded 9G file.  File uploaded successfully.  The only edit done to the upload pages was to remove the /4dcgi/ portion of the <Form> tag to work with ITK.
 
3.  Added the file upload demo pages to my application and attempted to upload 9G file.  Upload failed.  From this test I asserted that it is NOT the A4D page itself having the problem.  The upload pages from step 2 were used.
 
4.  I had made some adjustments to the original ITK shell in our application.  I removed these completely by pasting all of the original ITK code back in to our application or manually removing lines added.  After these changes the upload still failed.
 
5.  When using Insider to copy the entire group from the ITK Shell library to our database it causes insider to crash.  I am not sure what is going on here.  Our DB structure is about 30MB in size.  Sanity Check reported only one fatal error.  I am going to try to copy the ITK code again with a compacted structure (which appeared to fix the error reported by sanity check). 
 
6.  I did not copy the 'Active4D' table into the database.  I am using a different table (which I do specify in the shell). 
 
All other operations appear to work just fine.
 
I have also placed the unedited ITK Shell code into another 4D Based product we have here and experience the same problem.  When attempting to upload a 8.92G file I recieve a '400 Bad Request' error. On this database the 4D Insider copy works correctly and I use the entire A4D ITK shell code unmodified.  The Active 4D table is used in this version. 
 
Any other suggestions would be appreciated.  Thanks!
Reply | Threaded
Open this post in threaded view
|

Re: Uploading rather large files

aparajita
Administrator
NOTE: This thread is a repost of a thread on the Active4D support forum.


> When uploading a file over about 8.6G 'A4D Execute stream request '
> from the A4D_ITK Server method returns a 400 Bad Request.

It turns out Richard meant 8.6MB, not 8.6G! In any case, the "max
request size" setting in Active4D.ini was set high enough, so I am sure
it is a matter of the server running out of memory.

In general, allowing the upload of large files to a web server is _not_
recommended. It can easily be abused and easily crash the server.

    Aparajita
    Victory-Heart Productions
    [hidden email]
    www.aparajitaworld.com



Reply | Threaded
Open this post in threaded view
|

Re: Uploading rather large files

Richard Carpenter-2
Ok, I did some research into the memory usage when uploading files and it
does not look good.

I did basically 2 tests - one with ITK and one with 4D's web server.  In
both cases I used the Active 4D Demo database to upload a single 14MB file.

Both of these tests were with 4D Server 6.7.4 on Windows 2000 Server.

Here is what I saw :

4D's Web Server :
Windows Task manager shows 200MB in use on the machine.  On the upload.a4d
page I select the 14MB file.  The file upload succeeds but Windows Task
Manager (and 4D's database properties) show an increase in 4D memory usage
to 333MB.  130MB more than prior to submitting the page.

ITK's Web Server :
Windows Task manager shows about 199MB in use on the machine.  As previously
I select the a 14MB file to upload on the upload.a4d page.  Windows Task
Manager showed an increase of about 60MB.

Can anyone out there verify this behaviour or do I have something very
unusual occuring here?

At this point it is rather academic though.  Our clients would be uploading
files of that size or larger fairly often so we are looking at other file
upload options.  I would like to understand what is occuring however.


----- Original Message -----
From: "Aparajita Fishman" <[hidden email]>
To: <[hidden email]>
Sent: Thursday, September 19, 2002 11:30 AM
Subject: Re: [Active4d-dev] Uploading rather large files


> NOTE: This thread is a repost of a thread on the Active4D support forum.
>
>
> > When uploading a file over about 8.6G 'A4D Execute stream request '
> > from the A4D_ITK Server method returns a 400 Bad Request.
>
> It turns out Richard meant 8.6MB, not 8.6G! In any case, the "max
> request size" setting in Active4D.ini was set high enough, so I am sure
> it is a matter of the server running out of memory.
>
> In general, allowing the upload of large files to a web server is _not_
> recommended. It can easily be abused and easily crash the server.
>
>     Aparajita
>     Victory-Heart Productions
>     [hidden email]
>     www.aparajitaworld.com
>
> _______________________________________________
> Active4d-dev mailing list
> [hidden email]
> http://aparajitaworld.com/mailman/listinfo/active4d-dev
>
>