spaceblock Forum Rss Feed

New Post: Command line S3 tools

maxc — Wed, 30 Sep 2009 16:03:30 GMT

You might also like to have a look at http://s3.codeplex.com

New Post: Getting Exception Invalid path:

wakewatcher — Sun, 24 May 2009 06:32:38 GMT

I use your rescmd application (a wonderful program) to upload files. For example I've got a bucket 1072buckets and prefix 1000/2009/ and file name x.mp4. It all works I can upload and run the video etc. However when I try to look at it from Space Block I get the Exception: "Invalid path: '/1072buckets//'. and detail

CodePlex.Resourceful.CodePlexException: Invalid path: '/1072buckets//'.
   at CodePlex.SpaceBlock.Path.Parse(String value)
   at CodePlex.SpaceBlock.FS.S3FileSystem.InternalGetItems(Path folderPath)
   at CodePlex.SpaceBlock.FS.S3FileSystem.GetFolders(Path path)
   at CodePlex.SpaceBlock.UI.Controls.Explore.FoldersControl.<>c__DisplayClassb.<Expand>b__9()

The leading '/' on the bucket name looks suspicious but as I said in my application it all works. I was trying to use spaceblock to clean up the buckets (I have several that have this problem) but I can open them up.

-steve-

New Post: Code for Release 0.0.2.5

willbell — Fri, 30 Jan 2009 18:36:05 GMT

Hi John,

Thanks for this great tool which works well with Windows Azure's blob storage. Do you plan to upload the code for release 0.0.2.5?

Best regards,
William

New Post: S3 copy functionality?

rawe — Fri, 02 Jan 2009 23:15:42 GMT

Hi John

First of all: thank you for a great tool to manage S3 files!
I've tried several different applications (S3 Hub, S3 Browser, Cyberduck and many more) but your SpaceBlock program is simply just the best.

I've got one thing I would love to get into SpaceBlock, though: copy functionality.
Amazon has officially released the copy functionality (from beta to GA) a couple of months ago - please see http://developer.amazonwebservices.com/connect/ann.jspa?annID=360 for more info - so at least the API should be stable.

What I sorely needs is this: I would love to have the ability to choose a folder (that is: a 'virtual' folder inside one of my buckets) and copy it and the subfolders and files into another bucket of mine.
The main problem is that I made a bucket in the US part of S3 and have uploaded several gigabytes of data into it. Just to find that I made a mistake. I should have created the bucket in the EU part of S3. So as far as I know the only way to move everything from S3-US to S3-EU is to copy everything from on bucket (US) to another temporary bucket (EU), delete the original bucket (to free the bucket name) in the S3-US, create the bucket in the S3-EU and then copy all the data once again from the temporary bucket to the new (EU) version of the bucket.
All of this traffic would take a considerable amount of time if I have to download everything to my local computer instead of copying 'within' S3. Therefore the need for a copy function in SpaceBlock.

It would of course be great if the (hopefully) future copy functionality in SpaceBlock would retain all permission settings for files getting copied...

Do you have any plans to create such functionality?

Best

Rasmus Wehner
Denmark

New Post: Azure SQL Data Services connection

netgio — Mon, 01 Dec 2008 14:46:21 GMT

Hi John... nice looking tool and could be very helpful. So far I've been unable to connect to my recently registered Azure based SDS authorities. I think this is because the hostname has changed or at least a new one has been added :

data.database.windows.net

Do you have any plans for an update that would allow the SDS "base" hostname to be configured rather than hard coded to "blob.core...etc" or localhost?

Cheers
Gary

New Post: Windows Azure Blob Storage

davidjjon — Wed, 26 Nov 2008 12:09:16 GMT

Hi John,

I got in by using the Azure project name unique instead of the blob project name uniqueblob

I will regenerate the key this evening - I'm in Texas

It's a great tool that I really need - thank you very much for sharing it.

David Roh

New Post: Windows Azure Blob Storage

johnspurlock — Wed, 26 Nov 2008 11:59:04 GMT

Hmm, I'm seeing the same thing over here with those credentials. Have you tried regenerating your primary key? remember you can use your secondary key as well.

You can use the underlying Resourceful library to debug the actual http calls made. e.g. code looking like this:

AzureBlobStorageClient c = new AzureBlobStorageClient("UniqueBlob", key);
c.Tracer.AddListener(Console.Out);
c.GetContainers();

yields a request/response like this:

GET /?comp=list HTTP/1.1
Host:uniqueblob.blob.core.windows.net
User-Agent:CodePlex.Resourceful.Client 0.0.2 (http://www.codeplex.com/resourceful)
x-ms-date:Wed, 26 Nov 2008 11:52:26 GMT
Authorization:SharedKey UniqueBlob:zzBPb/73fD7znflPy/QSMwhKPihsuxNNwkDSmSE9VYQ=

400 One of the request inputs is out of range.
x-ms-request-id:0bc9f12d-a0f1-44c5-af4d-3aac2f4ff9b2
Content-Length:145
Content-Type:application/xml
Date:Wed, 26 Nov 2008 11:52:45 GMT
Server:Microsoft-HTTPAPI/2.0
<?xml version="1.0" encoding="utf-8"?><Error><Code>OutOfRangeInput</Code><Message>One of the request inputs is out of range.</Message></Error>

You may want to use the request-id (0bc9f12d-a0f1-44c5-af4d-3aac2f4ff9b2 for the above) to post on a microsoft forum for help.

New Post: Windows Azure Blob Storage

davidjjon — Wed, 26 Nov 2008 11:42:10 GMT

Thanks for the quick response and help.

The account name is UniqueBlob the key is oHXpN9lrOt/xpNBhxY4bAcjgKLC2l6i+uXyDS74iKsdbXnkkcqxwGH9KoDbL68+Ct2Aorzi/JTer3PEm1TocAQ==

The end point is http://unique.blob.core.windows.net

It still does not work for me.

I go to Options -> new -> add the account name and key and click Save.

CodePlex.Resourceful.CodePlexException: Settings for '(new)' are not valid: [OutOfRangeInput] One of the request inputs is out of range.. ---> CodePlex.Resourceful.Amazon.S3.S3Exception: [OutOfRangeInput] One of the request inputs is out of range.
   at CodePlex.Resourceful.Microsoft.Azure.AzureBlobStorageConnection.Assert(ClientResponse response, HttpStatus expectedStatus)
   at CodePlex.Resourceful.Microsoft.Azure.AzureBlobStorageConnection.ListContainers()
   at CodePlex.SpaceBlock.FS.AzureBlobStorageFileSystem.EnsureValid()
   at CodePlex.SpaceBlock.FS.AzureBlobStorageFileSystem.get_Caption()
   at CodePlex.SpaceBlock.UI.Controls.Tools.OptionsForm.OnSave()
   --- End of inner exception stack trace ---
   at CodePlex.SpaceBlock.UI.Controls.Tools.OptionsForm.OnSave()
   at CodePlex.SpaceBlock.UI.Controls.BaseForm.<>c__DisplayClassb.<>c__DisplayClassd.<SetupDialogWork>b__8()

Any help would be appreciated.
David Roh

New Post: Windows Azure Blob Storage

JohnSpurlock — Wed, 26 Nov 2008 01:16:14 GMT

You need to create a new storage project (New Project -> Storage Account). Then use the name of that project.

e.g. if your endpoint is http://foobar.blob.core.windows.net, the account name is foobar.

On Tue, Nov 25, 2008 at 7:46 PM, davidjjon <notifications@codeplex.com> wrote:

From: davidjjon

I have the key for my Windows Azure blog storage; however, I have no idea what to use for the Account Name - I have tried every combination that I can think of with no joy.

Any help would be appreciated.

David Roh
JK@SoftwareByDavid.com

Read the full discussion online.

To add a post to this discussion, reply to this email (spaceblock@discussions.codeplex.com)

To start a new discussion for this project, email spaceblock@discussions.codeplex.com

You are receiving this email because you subscribed to this discussion on CodePlex. You can unsubscribe or change your settings on codePlex.com.

Please note: Images and attachments will be removed from emails. Any posts to this discussion will also be available online at codeplex.com

New Post: Windows Azure Blob Storage

davidjjon — Wed, 26 Nov 2008 00:45:55 GMT

I have the key for my Windows Azure blog storage; however, I have no idea what to use for the Account Name - I have tried every combination that I can think of with no joy.

Any help would be appreciated.

David Roh
JK@SoftwareByDavid.com

New Post: unnamed folder error

JohnSpurlock — Sun, 28 Sep 2008 17:18:12 GMT

I'm curious as to what the bucket listing looks like, can you log on to http://s3.amazonaws.com/my.bucket/index.html and use the "list bucket" command to find out the name of the key (or keys) inside your bucket that are causing the problem?

I don't need the other keys, just the problematic ones - also feel free to scramble everything but the slashes ('/') before sending. (use the codeplex contact link on my profile page)

Thanks,
- John

New Post: unnamed folder error

vjer — Sun, 28 Sep 2008 17:09:32 GMT

sorry bout the post $0 problem- wonder if its google chrome doing that?$0$0$0

New Post: unnamed folder error

vjer — Sun, 28 Sep 2008 17:06:38 GMT

hi john, $0$0$0$0-yes the buckets/top-level list fine$0$0-nope, the bucket with the problem subfolder doesnt list, just shows 'loading...'$0$0-subfolder isnt hidden as far as i can tell from s3fox$0$0$0$0$0i need to keep the contents of the bucket, and ive tried deleting the unnamed subfolder via SB, but it prompts 'unhandled exception' error.. here's the first block of details, thanks again!$0$0$0$0$0$0$0$0$0************** Exception Text **************$0$0System.NullReferenceException: Object reference not set to an instance of an object.$0$0 at CodePlex.SpaceBlock.UI.Controls.Explore.BrowserControl.<BrowserControl_Load>b__19(Object , EventArgs ) in C:\in\projects\software\net\codeplex\spaceblock\Releases\0.0.2\Source\CodePlex.SpaceBlock.UI\Controls\Explore\BrowserControl.cs:line 604$0$0 at System.Windows.Forms.ToolStripItem.RaiseEvent(Object key, EventArgs e)$0$0 at System.Windows.Forms.ToolStripMenuItem.OnClick(EventArgs e)$0$0 at System.Windows.Forms.ToolStripItem.HandleClick(EventArgs e)$0$0 at System.Windows.Forms.ToolStripItem.HandleMouseUp(MouseEventArgs e)$0$0 at System.Windows.Forms.ToolStripItem.FireEventInteractive(EventArgs e, ToolStripItemEventType met)$0$0 at System.Windows.Forms.ToolStripItem.FireEvent(EventArgs e, ToolStripItemEventType met)$0$0 at System.Windows.Forms.ToolStrip.OnMouseUp(MouseEventArgs mea)$0$0 at System.Windows.Forms.ToolStripDropDown.OnMouseUp(MouseEventArgs mea)$0$0 at System.Windows.Forms.Control.WmMouseUp(Message& m, MouseButtons button, Int32 clicks)$0$0 at System.Windows.Forms.Control.WndProc(Message& m)$0$0 at System.Windows.Forms.ScrollableControl.WndProc(Message& m)$0$0 at System.Windows.Forms.ToolStrip.WndProc(Message& m)$0$0 at System.Windows.Forms.ToolStripDropDown.WndProc(Message& m)$0$0 at System.Windows.Forms.Control.ControlNativeWindow.OnMessage(Message& m)$0$0 at System.Windows.Forms.Control.ControlNativeWindow.WndProc(Message& m)$0$0 at System.Windows.Forms.NativeWindow.Callback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam)$0$0$0$0$0

New Post: unnamed folder error

JohnSpurlock — Sun, 28 Sep 2008 15:28:00 GMT

Hi there - would you mind explaining this a bit further?

- Can you list your buckets? (top-level folders in spaceblock)
- Can you list your bucket with the problematic subfolder?
- Is the problem that your subfolder is simply hidden?

You should be able to delete a bucket and all of its contents, no matter how problematic, by right-clicking the bucket (top-level folder) and choosing delete.

Hope that helps,
- John

New Post: unnamed folder error

vjer — Sun, 28 Sep 2008 05:40:24 GMT

hello,$0fired up SB but it isnt showing contents of buckets (which list fine).. however, im sure its due to a folder with no name, which was created by a S3/php class script.. (plus, i cant delete the folder, at least via firefox extension).. any suggestions would be very appreciated!$0$0$0$0$0vin$0

New Post: Command line S3 tools

wakewatcher — Thu, 04 Sep 2008 04:44:33 GMT

This is excellent!! Works great and I expect many to make use of it. I'll add my comments over on its codeplex site.

Thanks!

-steve-

On Wed, Sep 3, 2008 at 8:13 PM, JohnSpurlock <notifications@codeplex.com> wrote:

From: JohnSpurlock

Ok, I just started a new command-line tool called rescmd and posted the first version over on http://codeplex.com/resourceful

Right now, it is very simple and only supports a single service (s3) and a single action (put-object). You should be able to upload a file (including ensuring the bucket exists) using the following command:

rescmd s3 put-object aws-key: aws-secret: file: bucket: key-prefix:path/to/folder/ create-bucket:true acl:public-read

This command-line tool includes some of the same code that SpaceBlock builds on, wrapped up into a small single executable. Let me know if it works for you and let me know what other operations you'd find useful. I've been wanting to do this for a while, and you prompted me to get started.

Thanks!
- John

New Post: Command line S3 tools

JohnSpurlock — Thu, 04 Sep 2008 03:13:01 GMT

Ok, I just started a new command-line tool called rescmd and posted the first version over on http://codeplex.com/resourceful

Right now, it is very simple and only supports a single service (s3) and a single action (put-object). You should be able to upload a file (including ensuring the bucket exists) using the following command:

rescmd s3 put-object aws-key:<yourkey> aws-secret:<yoursecret> file:<yourfile> bucket:<thebucket> key-prefix:path/to/folder/ create-bucket:true acl:public-read

This command-line tool includes some of the same code that SpaceBlock builds on, wrapped up into a small single executable. Let me know if it works for you and let me know what other operations you'd find useful. I've been wanting to do this for a while, and you prompted me to get started.

Thanks!
- John

New Post: Command line S3 tools

wakewatcher — Wed, 03 Sep 2008 07:11:23 GMT

Thanks for the pointer. I looked but didn't find anything. My application is pretty straight forward. (But beyond my capabilities I'm afraid.) But it seems just an S3 explorer is beyond many peoples capabilities.

I was hoping I could do something like this from the command line. "S3upload.exe -public publickey -secret secretkey -f file(s) -b bucketname -f folder -acl readall" which would then take "file" and insure that it was uploaded to the bucketname/folder with acl set to readall. My work flow goes like this: On the PC I import a series of video clips in AVI format then I have to start crunching on them and convert them to a mp4 format. It would be nice to be able in the background to upload each mp4 file as it is created. Since it takes longer to crunch them that it does to upload them then by the time I'm done crunching 150 files they would also already be uploaded. In addition the user wouldn't have to manually upload them. I suppose they would still need to use something like SP to set up the buckets etc. I use autohotkey as a scripting language to do all sorts of things and I suspect others would find a command line S3 organizer of great use.
I'm sloshing through picking up php and mysql. I've enjoyed mashing things together but I don't really grok the whole object oriented paradigm.

Any other suggestions would be appreciated.

-steve-

On Tue, Sep 2, 2008 at 6:02 PM, JohnSpurlock <notifications@codeplex.com> wrote:

From: JohnSpurlock

Have you tried the S3 Solutions Catalog? http://solutions.amazonwebservices.com/connect/kbcategory.jspa?categoryID=66

I know there are command line tools out there, but most of them require perl, ruby, java, etc.

It would not be difficult create a small windows exe that repackages the S3 lib that SpaceBlock uses, I'd be willing to put something like this together if you came up with the requirements (and they were simple enough...)

Thanks,
- John

Read the full discussion online.

To add a post to this discussion, reply to this email (spaceblock@discussions.codeplex.com)

To start a new discussion for this project, email spaceblock@discussions.codeplex.com

You are receiving this email because you subscribed to this discussion on CodePlex. You can unsubscribe on codePlex.com.

Please note: Images and attachments will be removed from emails. Any posts to this discussion will also be available online at codeplex.com

New Post: Command line S3 tools

JohnSpurlock — Wed, 03 Sep 2008 01:02:44 GMT

Have you tried the S3 Solutions Catalog? http://solutions.amazonwebservices.com/connect/kbcategory.jspa?categoryID=66

I know there are command line tools out there, but most of them require perl, ruby, java, etc.

It would not be difficult create a small windows exe that repackages the S3 lib that SpaceBlock uses, I'd be willing to put something like this together if you came up with the requirements (and they were simple enough...)

Thanks,
- John

New Post: Command line S3 tools

wakewatcher — Sun, 31 Aug 2008 17:05:33 GMT

I'm finding with my application (www.gamedayfilmz.com) that my user groups (Football coaches) are really struggling with these (SpaceBlock, BucketExplorer, S3 Organizer) S3 explorers. Is there any Windows based command line utilities out there? For my application I've got to encode and compress video and then send it to their S3 account. If there were command line utilities I could put some scripts together to do this for them. Thanks.