If you have some extra money you’ll like to donate. That would be really helpful!
Powered by Donation Can.

Forum

Welcome Guest 

Show/Hide Header

Welcome Guest, posting in this forum requires registration.
Pages: [1]
Author Topic: Kinect Society - NUI Social Network Prototype (Bachelorthesis)
Jens Walz
Newbie
Posts: 1
Post Kinect Society - NUI Social Network Prototype (Bachelorthesis)
on: August 2, 2011, 10:01

Hello my fellow Kinect hacking and interface design friends,

my name is Jens Walz and I’m studying “Informationdesign” in the sixth semester at Media University Stuttgart (south-west Germany). I’m currently working on my bachelorthesis with the topic “Conception, design and implementation of a natural user interface social network prototype”.
You can follow my development progress on my bachelorthesis weblog (unfortunately it’s only available in german, but the illustrations, wireframes, mockups and interactions should speak for themselves):

http://www.kinect-society.net/

How you might can already imagine it’s all about NUI interaction, interface development and design of a social media application. The application is called “Kinect Society” and it will get realized in ActionScript 3 (and of course the OpenNI Win32 Wrapper).

In the last two months I created persona scenarios, use cases, flowcharts, planned the interface, the interactions and input methods and designed out of the wireframes the finished mockups of the application. Now it’s time to get the whole application to life (with my creepy AS3 skills ;) ) an maybe I’ll bother the community with a few questions but I’ll release the application and the source code after the prototype is finished.

Quick preview (way more 1920x1080 images are available on the weblog):

Preview mockups:
Image
Image
Image
Image

Preview wireframes:
Image
Image
Image
Image

Preview interactions:
Image
Image
Image
Image

Preview progress:
Image

Stay tuned ;)

Jens Walz

http://www.jens-arendt-walz.de/
Pages: [1]
Mingle Forum by cartpauj
Version: 1.0.33.3 ; Page loaded in: 0.032 seconds.

  • Pingback: as3kinect airdrums by jhonc | as3kinect

  • John C

    Awesome work. Looks like the real thing. This kind of interface has a lot of potential to be packaged up and reused as a set of UI components for general kinect devlopment.

    You don’t need any 3d engine to draw the skeleton if you’re just using a straight 2d projection like that, just use the x/y coords with flash’s drawing API and it’ll look fine. ;) Compiles quicker too.

  • fox

    Hey this is great work! I would like to work more closely with some other like-minded developers, is there PM system here?

    • Anonymous

      Uhh i think there isn’t one… :S but you can ask for their mail if you want to talk to them.

  • Jason

    It won’t be available in the OpenKinect Wrapper as the drivers don’t support the Skeleton tracking.

  • amb

    ###### Got client
    got bad command (23)
    Disconecting client…

    What does this mean?

    • imekinox

      Commands are 8 bytes size, this means you lost 1 byte somehow from the client to the server, or the swf file is requesting for the policy file just before anything is sent to the server, are you running the SWF on the browser or something?

  • jaredrawk

    Hello Eugene,

    For easy projector calibration I often take everything and push it to a single bitmap in a second AIR window designed to go full screen for projector output. I then typically paint that bitmap as triangles or as a FreeTransform bitmap, like th gummy bitmap class from FlashAndMath

    http://www.flashandmath.com/intermediate/gummy/

    You can then easily and quickly scale for keystoning etc.

    Also there are plenty of openGL tricks and hacks that can do this. Some of them are used by softwares like Resolume.

    Cheers!

    Jared

    • jaredrawk

      sorry I gues it was taktik who posted this not eugene. Info the same.

      Cheers

  • mocean

    Is anyone working on this besides the original poster? I set up the build environment and took a quick look, but I don’t really have the time. I don’t want to invest a bunch of time only to find someone else is on it.

    Instructions to set up the build environment on OSX (from the SensorKinect readme https://github.com/avin2/SensorKinect):
    - Install darwin ports
    - Install libtool
    - Install libusb
    - Install OpenNI unstable
    - Install SensorKinect
    - Install NITE unstable

    Now, take the zip that lumentra posted and make sure you change the headers and the library properties of the project to point to the headers and the libraries in the OpenNI/Include and OpenNI/Lib directories.

    Should compile and run. If I don’t hear anything I’ll play with this a bit tonight.

  • Scottsbull

    Anxiously awaiting a release! Thanks for your hard work mocean and lumentra!

  • Hasufel

    Waiting for release too! :)

  • Yoav

    Like to develop something solid using Flex / Air
    However got stuck with the basics not working.
    Using PC with windows XP .
    - installed drivers ( OpenKinect) OK
    - Running any of the apps , glview, glpclview and as3-server not working
    - tried both binaries and generated from source, in both cases none of the apps run.
    - when trying to run glview, glpclview console window briefly appears and immediately closes
    - generate the binaries by following word-by-word the instructions on this site.
    - as3-server.exe open the console and displays an Error : Invalid Index [0], as soon as starting the (flash) test.exe the server bombs out. and in the event log I see : “Application Failure as30-server. exe 0.0.0.0 in a s3-serve r.exe 0. 0.0.0 at offset 000013e2″.

    any ideas where to look / what to do will be appreciated

    • Anonymous

      Seems that the drivers are not installed… Invalid index 0 means that no device was found.

      • Yoav

        OK, thanks. I’ll Uninstall and re-install the OpenKinect drivers.
        Could be that due to multiple installations ( including PrimeSense & CodeLabratories ) the wrong drivers are currently attached..

  • Clayton

    You guys think its possible to import a 3d file (collada or whatever) and have the skeleton points manipulate predefined bones in the model? I’ve not messed with it yet, but interested in trying if it may be possible!

  • Jake

    Now openNI wrapper cannot use tracking hands without a calibration. Is it could be without the psi pose soon? And after leaving from a camera view, user come in the camera view again, then cannot get skeleton data.

  • Maartenbressinck

    Wave, Push and Swipe are the gestures we are looking for :) . We are all quite good with AS3 so once we can access those events in AS3 the playing can begin.

    If it’s just not possible to port in to OSX we might consider developing it for Windows.
    Anyway thanks! I’m hoping you find some time between your project but don’t bother if it’s just impossible for you.

  • http://www.facebook.com/jordan.rose Jordan Rose

    Awesome! Thanks Lumentra. I have a Flash application working on the PC but would love to port it over to the MAC with openNI tracking. The community really appreciates your hard work on this.

  • http://twitter.com/arenddeboer arenddeboer

    This is amazing lumentra, keep it up!

  • Deniro

    I have some question about the skelett distanse, how Can I get this information? Is there a way to get the skellette distance from camefra? Also I need to know if the openNi wrapper works with blobs?
    Thanks for any help

  • Thiago Felix

    Congratulations lumentra its works awesome here, im playing all published demons from my mac. Amazing.

  • Blackcode

    In my oppinion you should wait for m$ sdk… what we all tried to do is reinventing the wheel, years of development. After sdk is out a wrapper will be written qith gesture ,skeleton and every algoritm present in xbox. Till then gl…;)

  • http://twitter.com/hadziq Hadziq Fabroyir 哈明飛

    When I clicked the Pong source link (http://www.disturbance.fr/partage/Pong.zip) ,
    the page only showed this message: [i]Erreur : la page demandée n’a pas été trouvée.[/i]
    It seems that the link is broken .
    Can you help to fix it up ?

    Thank you . :)

  • http://www.facebook.com/profile.php?id=1269275945 Carlos David

    imekinox hola soy de venezuela, necesito que me ayudes a compilar el server ,que porgrama necesito instalados para hacerlo ya que me baje el fuente y tengo el visual c++ express pero me da errores en la librerias que incluye y yo se poco de visual c++

  • Andrea_delia

    Hi Lumentra, can I have some help about your as3-server_xcode?
    How I can build it? Can you tell me step by step what ti needs and what I have to do?
    I want build it with Eclipse under Linux Ubuntu 10.10 it’s ok? is possible?

    thank you very much in advance… :)

    Bye.

  • sajjan

    Hi I have problem with calibration, after some time user is getting lost the calibration and again its difficult to re calibrate the pose. I think the problem with server side. How we  can solve this?? Do you have the updated server for RGB??

  • Sajjan

    Hi I have problem with calibration, after some time user is getting lost
    the calibration and again its difficult to re calibrate the pose. I
    think the problem with server side. How we  can solve this?? Do you have
    the updated server for RGB??

  • Ariel Schvartz

    Hey, really nice how u got the ARGB. But the skeleton thing is not working very well! Any ideas why??

    • John

      Sounds like a bandwidth problem. If you want the skeleton to work reliably, don’t use the video feed at the same time.

      • Ariel Schvartz

        The thing is not the reliably, it don’t works at all. Nothing appears.

        • Luiza Prata

          even for me… [_socket.addEventListener(as3kinectSocketEvent.ONDATA, dataReceived)] throws nothing

  • Edson

    Hi All,

    I’d like to know how i can sort out this problem, Always that I ran glview I saw it.

    ### Wait depth client
    ### Wait rgb client
    ### Wait data client
    ### Got depth client
    ### Wait depth client
    Error: Invalid index [0]
    Segmentation fault

    I’ve already connected the kinect, I am trying to run it on the mac mini snow leopard, Does anyone have some advice?

  • Johnrake

    How do I return the depth of a pixel (X, Y coord)?Thanks

  • Sanjin Muftic

    hello, i am getting no video capture from the kinect. Few months ago I installed it just fine and everything worked, but when i came back to it about two weeks ago – all i get is send_cmd returned 4 [0005 0001], 0000 expected
    everytime i run glview
    any ideas?

  • huckfinn

    i think the only thing that xbox live have compare to psn is the cross game chat. but they are pretty much the same.

  • Yali Amit

    I am using as3kinect on Macos 10.6.8 on a Macbook pro.
    When I use the as3kinect wrapper with Flash Pro CS5.5 and run the movie using the `test movie’ option everythingworks fine. However when I publish it as an `app’ in Macos using Flash 10.2 or AIR 2.6 and run it as a standalone it is very slow and choppy. Any ideas why this difference?

  • Jetjimenez87

    I’ve tried this and really like it. It has around 20 joint positions, and tracks skeletons automatically. IMO, it’s a great substitute for openni. BUT as I’m using the kinect for commercial advertising projects, the windows sdk is unfortunately off-limits.. So I’m sticking with OpenNI and the OpenNI wrapper for now. Come to think of it, it would be awesome an openni AIR native extension

  • MickyMike

    Many thanks for this example!! 

Easy AdSense by Unreal