CodePlex.SpaceBlock

Closed Feature: New mime type - text/javascript [2816]

JohnSpurlock — Thu, 16 May 2013 04:19:47 GMT

This is required for gzipped javascript files.
Even better - can we edit the list of mime types manually?

Source code checked in, #81799

Project Collection Service Accounts — Mon, 01 Oct 2012 21:57:23 GMT

Upgrade: New Version of LabDefaultTemplate.xaml. To upgrade your build definitions, please visit the following link: http://go.microsoft.com/fwlink/?LinkId=254563

Source code checked in, #81798

Project Collection Service Accounts — Mon, 01 Oct 2012 21:51:05 GMT

Checked in by server upgrade

Commented Issue: Memory Leak and Bug? [3362]

dneb — Fri, 19 Aug 2011 15:25:54 GMT

I was using Spaceblock last night and I was attempting to list the contents of one of my buckets. Now I have the bucket divided into a folder type structure, and accessing the other "folders" was successful. But when I tried to access a particular "folder" that has probably 10,000+ objects in it, Spaceblock just sat there with it's loading screen. I left the application open (don't know why), and after about an hour my system began to run dreadfully slow. I opened the Task Manager and lo and behold, Spaceblock was using 1.3 GB of my memory. I have attached screenshots for those interested in helping debug this issue (urls for those that don't trust the dowload). Here are the issues I'd like addressed:

1. Why can't I get a file listing when a "folder" has a lot of objects in it?
2. Why is Spaceblock using so much memory?

Thanks!

http://www.kmg.net/pub/spaceblock-1.png
http://www.kmg.net/pub/spaceblock-2.png
http://www.kmg.net/pub/spaceblock-3.png
Comments: ** Comment from web user: dneb **

I had something somewhat similar. I was trying to delete a gigantic bucket (a JungleDisk backup bucket). No idea how many files, but it's huge. It ran all night and in the morning the process was using 7.5GB of memory.

Created Issue: UNC paths don't work for source paths [10160]

redwards1966 — Thu, 27 Jan 2011 18:13:03 GMT

While using the MSBuild S3Upload task I found that UNC paths don't work at all so I was required to map a drive to the network location instead.

Commented Issue: Upload large files to Azure Blob Storage fails [3875]

c0d3 — Mon, 23 Aug 2010 07:04:24 GMT

Uploading large files to Azure Blob service returns this error:
<?xml version="1.0" encoding="utf-8"?><Error><Code>RequestBodyTooLarge</Code><Message>The request body is too large and exceeds the maximum permissible limit.</Message><MaxLimit>67108864</MaxLimit></Error>
Comments: ** Comment from web user: c0d3 **

The request body is to large - error may be caused by trying to upload the same file many times. When files are uploaded it is uploaded in eg. 64KB blocks, and Azure may have a MaxLimit for how many blocks can be uploaded, when this limit is reached, the error is thrown. Blocks are still in the blobstorage but uncomittet, I fixed this in one of my projects by deleting a file blob if the stream prosition is set to 0.
container.DeleteBlob(blobProperties.Name) and then uploaded the same file with a block size of 1MB. Hope this helps.

Source code checked in, #55578

_TFSSERVICE — Mon, 26 Jul 2010 20:06:06 GMT

Checked in by server upgrade

Created Issue: Unable to create $root container [6280]

jaybo_nomad — Mon, 16 Nov 2009 05:15:45 GMT

The Nov 2009 release includes a pseudo root folder called "$root". Items in this folder appear in the root of the storage tree.

I can't seem to create a container of this name by right clicking and selecting "New Folder...".

New Post: Command line S3 tools

maxc — Wed, 30 Sep 2009 16:03:30 GMT

You might also like to have a look at http://s3.codeplex.com

Reviewed: SpaceBlock 0.0.2 (Jun 05, 2009)

ffolini — Fri, 05 Jun 2009 20:43:30 GMT

Rated 4 Stars (out of 5) - Not the most advanced UI, but it does the job! Thank you to the developers for sharing it.

Created Issue: Slow Rename on S3

ffolini — Fri, 05 Jun 2009 20:41:37 GMT

Renaming a file on S3 takes several minutes. I don't know if this is a limitation of S3 or a problem of SpaceBlok. Having a faster Rename would be nice.

Source code checked in, #25142

JohnSpurlock — Fri, 29 May 2009 03:14:23 GMT

Release 0.0.2.6 - Initial support for the Sun Cloud Storage api

Updated Wiki: Home

JohnSpurlock — Fri, 29 May 2009 02:59:57 GMT

Project Description

SpaceBlock is a simple Windows front-end for managing Amazon S3, Nirvanix, Azure Blob Storage, and now Sun Cloud Object Storage online service accounts.

This project is fully open-sourced via the MIT license, contributions welcome!

Make a PayPal donation...

To Install and Run (via ClickOnce):

http://spaceblock.s3.amazonaws.com/install
Once installed, the application can be launched via the start menu

Features

Amazon S3 Integration
- Support for EU buckets
- Handles difficult key/bucket names (like unicode chars outside of the ASCII range & invalid urls)
- Edit ACL, Bucket Logging Status, generate signed URLs
- Leverages the cross-platform CodePlex.Resourceful REST library (http://www.codeplex.com/resourceful)
Define multiple accounts (e.g. allowing for streaming transfer between S3 accounts)
Vista compatible
Saved settings encrypted via the Windows Data Protection API (http://msdn2.microsoft.com/en-us/library/ms995355.aspx)

Screenshot

Solution Layout

The codebase currently consists of two solutions:

SpaceBlock.2005 (VS2005)

CodePlex.SpaceBlock
- Core library (for abstracting file systems, etc)
CodePlex.SpaceBlock.MSBuild
- MSBuild task library
CodePlex.SpaceBlock.NAnt
- NAnt task library
CodePlex.SpaceBlock.Test
- MSTest project
CodePlex.SpaceBlock.UI
- WinForms front-end

SpaceBlock.2008 (VS2008)

CodePlex.SpaceBlock
CodePlex.SpaceBlock.UI
CodePlex.SpaceBlock.Test35
- API examples using some of the new c# 3.0 features

What's New

Release 0.0.2.6
- Experimental support for a new file system type based on the Sun Cloud Object Storage api (just in time for JavaOne).

Release 0.0.2.5
- Azure storage settings now make it easy to connect to the local development storage fabric: check Use Development Storage.

Release 0.0.2.4
- Experimental support for a new file system type based on the Windows Azure Blob Storage api.

Supports basic folder management functions, transfers, metadata, and ACL (public/private containers)

Release 0.0.2.3
- Added a new content-type "text/javascript" to the static list
- New "Custom..." option to choose a content-type not in the static list

Release 0.0.2.2
- Added the ability to configure the S3 service host (to connect to an S3 clone instance via baltic-avenue)

Release 0.0.2.1
- Added a new file system type based on the Sql Server Data Services beta service http://www.microsoft.com/sql/dataservices/default.mspx

Release 0.0.2.0
- Added mime types for flash files (FLV and SWF)
- Fixed Nirvanix file system for file uploads (broken by a Nirvanix api upgrade)
- Using the new Resourceful library 0.0.2

Release 0.0.1.13
- Handles intermittent S3 server errors more gracefully (retry requests with exponential backoff) - especially noticeable when uploading a large number of small files
- New Feature: Bucket creation dialog now shows bucket name availability

New Feature: Remember values used in the Edit Metadata dialog (user request)

New Feature: Ability to display file times in UTC time (user request)

Release 0.0.1.12
- Enhancement: Prompt to exit if transfers are active
- Enhancement: Skip S3 log files that cannot be accessed (occasionally unreadable)
- New Feature: Set S3 default transfer ACL to private, public-read, or bucket (private or public-read depending on bucket ACL)

Release 0.0.1.11
- Ability to perform server-side file renames on S3! (thanks to the new COPY object beta feature)

Release 0.0.1.10
- Ability to set custom HTTP headers when uploading to S3

Release 0.0.1.9
- Enhanced Amazon S3 url generation dialog to include public urls (user request) & virtual host-style urls in addition to signed urls

Release 0.0.1.8
- Quick fix to underlying CodePlex.Resourceful library that should improve S3 retry logic

Release 0.0.1.7
- Enhancement: Deleting large numbers of files from an S3 filesystem is now much faster (and happens in the background)
- New Feature: Open file - launches the file in the OS-default application (or in explorer if no default)

Release 0.0.1.6
- New Feature: Transfers View - manage multiple simultaneous transfers between file systems (similar to Opera's transfers tab).

Release 0.0.1.5
- Automatic handling of time differences between the local machine and Amazon's S3 servers. Should minimize or eliminate RequestTimeTooSkewed responses.

Release 0.0.1.4
- Reduced the number of resources loaded during the initial ClickOnce launch
- Up-front file-system validation
- What's New dialog after every version upgrade
- New Feature: Support for virtual drives backed by the Nirvanix storage network (http://www.nirvanix.com)

Release 0.0.1.3
- New Feature: Analyze S3 Server Logs context-menu option. Select one or more log files to enable command.

New Post: Getting Exception Invalid path:

wakewatcher — Sun, 24 May 2009 06:32:38 GMT

I use your rescmd application (a wonderful program) to upload files. For example I've got a bucket 1072buckets and prefix 1000/2009/ and file name x.mp4. It all works I can upload and run the video etc. However when I try to look at it from Space Block I get the Exception: "Invalid path: '/1072buckets//'. and detail

CodePlex.Resourceful.CodePlexException: Invalid path: '/1072buckets//'.
   at CodePlex.SpaceBlock.Path.Parse(String value)
   at CodePlex.SpaceBlock.FS.S3FileSystem.InternalGetItems(Path folderPath)
   at CodePlex.SpaceBlock.FS.S3FileSystem.GetFolders(Path path)
   at CodePlex.SpaceBlock.UI.Controls.Explore.FoldersControl.<>c__DisplayClassb.<Expand>b__9()

The leading '/' on the bucket name looks suspicious but as I said in my application it all works. I was trying to use spaceblock to clean up the buckets (I have several that have this problem) but I can open them up.

-steve-

Commented Feature: Proxy support

adamhems — Fri, 17 Apr 2009 14:11:51 GMT

Hi,
SpaceBlock runs OK at home but when I attempt to run it at work I recieve the following error. This occurs when I attempt to save the S3 Settings in the Options window. I susupect it's a firewall issue, is there any facility to work through a firewall which requires a proxy username and password.

CodePlex.Resourceful.CodePlexException: Settings for '(new)' are not valid: The given key was not present in the dictionary.. ---> System.Collections.Generic.KeyNotFoundException: The given key was not present in the dictionary.
at System.ThrowHelper.ThrowKeyNotFoundException()
at System.Collections.Generic.Dictionary`2.get_Item(TKey key)
at CodePlex.Resourceful.Amazon.S3.S3Connection.Unexpected(ClientResponse response) in C:\in\projects\software\net\codeplex\resourceful\Main\Source\CodePlex.Resourceful\Amazon\S3\S3Connection.cs:line 587
at CodePlex.Resourceful.Amazon.S3.S3Connection.ListBuckets() in C:\in\projects\software\net\codeplex\resourceful\Main\Source\CodePlex.Resourceful\Amazon\S3\S3Connection.cs:line 197
at CodePlex.Resourceful.Amazon.S3.S3Connection.get_Owner() in C:\in\projects\software\net\codeplex\resourceful\Main\Source\CodePlex.Resourceful\Amazon\S3\S3Connection.cs:line 141
at CodePlex.SpaceBlock.FS.S3FileSystem.get_ShortCaption() in C:\Users\wzm48g\Documents\Visual Studio 2008\Projects\SpaceBlock 0.0.2\Source\CodePlex.SpaceBlock\FS\S3FileSystem.cs:line 54
at CodePlex.SpaceBlock.FS.S3FileSystem.get_Caption() in C:\Users\wzm48g\Documents\Visual Studio 2008\Projects\SpaceBlock 0.0.2\Source\CodePlex.SpaceBlock\FS\S3FileSystem.cs:line 46
at CodePlex.SpaceBlock.UI.Controls.Tools.OptionsForm.OnSave() in C:\Users\wzm48g\Documents\Visual Studio 2008\Projects\SpaceBlock 0.0.2\Source\CodePlex.SpaceBlock.UI\Controls\Tools\OptionsForm.cs:line 81
--- End of inner exception stack trace ---
at CodePlex.SpaceBlock.UI.Controls.Tools.OptionsForm.OnSave() in C:\Users\wzm48g\Documents\Visual Studio 2008\Projects\SpaceBlock 0.0.2\Source\CodePlex.SpaceBlock.UI\Controls\Tools\OptionsForm.cs:line 85
at CodePlex.SpaceBlock.UI.Controls.BaseForm.<>c__DisplayClassb.<>c__DisplayClassd.<SetupDialogWork>b__8() in C:\Users\wzm48g\Documents\Visual Studio 2008\Projects\SpaceBlock 0.0.2\Source\CodePlex.SpaceBlock.UI\Controls\BaseForm.cs:line 141
Comments: ** Comment from web user: adamhems **

The solution is simple - two lines of code added to the Resourceful library. Please see http://resourceful.codeplex.com/Thread/View.aspx?ThreadId=53648

Created Issue: Upload Greater than 4MB file to Azure Development Storage fails

pstatho — Thu, 12 Mar 2009 02:36:12 GMT

With CloudDrive I can upload >4MB files to the local development storage, however with SpaceBlock I get an error.

There error that is return is:

500 Server encountered an internal error. Please try again after some time.
Content-Length:172
Content-Type:application/xml
Date:Thu, 12 Mar 2009 02:33:37 GMT
Server:Nephos Blob Service Version 1.0 Microsoft-HTTPAPI/2.0
<?xml version="1.0" encoding="utf-8"?><Error><Code>InternalError</Code><Message>Server encountered an internal error. Please try again after some time.</Message></Error>

Commented Feature: Proxy support

adamhems — Mon, 09 Mar 2009 14:49:54 GMT

I hit this too, also because there is a Proxy Server at my work location. Works fine from home.

Created Issue: Upload large files to Azure Blob Storage fails

pstatho — Sun, 01 Mar 2009 21:59:18 GMT

Reviewed: SpaceBlock 0.0.2 (Feb 17, 2009)

fkiller — Wed, 18 Feb 2009 02:35:30 GMT

Rated 4 Stars (out of 5) - Nice approach! I need this kind of app. But fail to connect my SDS.

New Post: Code for Release 0.0.2.5

willbell — Fri, 30 Jan 2009 18:36:05 GMT

Hi John,

Thanks for this great tool which works well with Windows Azure's blob storage. Do you plan to upload the code for release 0.0.2.5?

Best regards,
William