media tools in java

sound files for testing

menu options not commands
- no refresh
- window title - filename
- also note the variable name and show a timestamp
- toby knows about accessing the namespace: futuretoby @ yahoo

pixel viewer
- x,y coordinates
- r,g,b values
- zoom in - maybe a magnification area
- color map? (color picker)

sound viewer
- highlight part of the graph and play that
  - show value (amplitude) at each index
  - play before and play after
- zoom out to a "compressed" view
- set the scale so that an increase/decrease in volume looks different
- magnifier(same as the one we use for the pixel viewer)?
- look into a live signal and spectrum viewer
- FFT would be nice
- no recording
- no trim

progress!

JavaSound
- done! te

sted with all old homeworks, no errors. see the JES Sum03 Repository

also i've checked a few other basic things re: writing files (overwriting, creating new files if nothing exists) and such - there are also lots of pretty javadocs before all the methods
no BackgroundCloser class
using a byte[] (instead of a Byte Vector)... maybe this will make things a little faster? also, most of the manipulation is done through java api functions rather than directly changing the buffer
we support stereo sound, big endian & little endian byte order, signed&unsigned pcm, alaw & ulaw encodings - everything java can do we can do :)
- er.. well.. we can't currently do setSample for unsigned pcm, anyone good with bit-shifting? i'm not quite so confident in my own abilities... or we can convert the file to signed pcm using java's built-in functionality. this might take a lot of time/overhead, but i kindof doubt we'll see any in this format anyway. right now it just prints an error saying that setting samples for this sound format isn't supported.
methods to explicitly return left and right samples for stereo sound separately (the generic getSample() method still returns just the left sample as default)
in (blocking)playAtRateDur, the sampleRate is now changed through the AudioFileFormat, so that the AudioInputStream and SourceDataLine deals with playing sounds faster or slower (instead of us directly messing with the byte array)
also, we have playAtRateInRange, simmilar to playAtRateDur, but you get to specify both a starting and stopping location instead of just the frame to end at.
no off-by-one errors (at least i havent heard any yet... i've tried sounds over 2 minutes long thus far with no problems - and i even use one of those problematic macs ;))
the new file is 0-indexed because of all of the byte manipulation its just easier to implement this way. the media.py file includes wrappers for all of the functions and they implement the apperance of 1-based indexing for getting and setting frames and samples to anyone using JES
this isn't something i'd want to tackle before the sound viewer, but if i finish before the end of the summer, are we interested in support for other media formats? (right now, the java functions support only aiff, au, wav) there seem to be different classes in the api for manipulating midi files, which i think we could incorporate, and there are conversion functions "out there" for using java to play things like mp3s..

sound viewer progress
- still working on the zoom, but everything else should work. check it out, and let me know what you think.
  - are the colors good?
  - i was thinking about a clear selection button, but there are a lot of buttons already, would that make it too busy? where would be a good location?
  - i could especially use some help from those of you using windows, as i've only tested thus far on my mac
    - man, after running it on one of the windows 2000 boxes in the coc, i'm ready to trade in my mac! java is so fast!!!!!!! still need to test on xp though
- sound viewer screen shots

JavaPicture
- Is all done. I need to test the old homework files yet so once I do that it will be up on the coweb.
- it has wonderful javadoc's
- added more try and catch blocks to deal with exceptions
- getCanvas is now a public function to allow the JavaPicture to be moved around. It adds a lot of flexiblity
- added a JOptionPane to notify users of the lack of a picture or a bad file name.
- cleaned up the code

pixel viewer progress
- Is also done. I need advice on the Zoom window (bigger/smaller or less zoom/more zoom) or if it really matters that much.
- It gives to x,y, and rgb values from the mouse location on the picture
- It zooms in real time around the mouse as well.
- Pictures appear in a scrollPane when needed.
- the code is JavaDoc'd
- changed the zoom method to use getScaledInstance...it is a memory hog
- made mouse drags the method for getting values
- add a color window so they could see what color the pixel is
- zoomed pictures reflect actual pixels by adjusting for the zoom factor
- the window size is adjustable and opens relative to the image size
- possible problems are mainly just memory...it runs out on a 500% zoom. This might be aleviated by the -Xmx256 but I haven't added it to the main program yet. If thats the case...a smaller zoom will have to due
- Check it out at Keith

ellie and Keith

VERY exciting progress. Any chance for screenshots? Mark Guzdial

BTW, the MIDI stuff is VERY COOL! I tried to post on the Toby page, but it's too big and Greek IE isn't happy with the page save. I'm thrilled–this has GOT to go into the book! WE CAN DO GRAPHS AND HIERARCHY AND TRAVERSALS AND STAY TRUE TO A MEDIA CONTEXT! (Oh, man – this book is getting BIG!) WAY TO GO, TOBY! Mark Guzdial

scp.html

????

Links to this Page

Sum03 JES Development last edited on 25 October 2003 at 5:41 pm by OL117-12.fibertel.com.ar
ellie last edited on 6 August 2003 at 3:16 pm by adsl-158-57-87.asm.bellsouth.net
Keith last edited on 30 December 2004 at 12:55 pm by cache6-1.ruh.isu.net.sa