Zhikai Wang Homepage

Heteroclinic.net logo

www.heteroclinic.net

	Two-pass 3D Object and Mouse Collision Detection 20130731 Introductio TwoPass3DObjectAndMouseCollisionDetection.pdf In computer graphics, the 3D models are projected to the 2D canvas pane of a GUI for real visualization. A mouse click event can get the point position in the 2D canvas pane. If we want to get the real 3D model's particular position projected to the 2D pixel coordinate, probably we have to un-project the 2D point. At least, it will involve depth test. Accurate computation may also involve ray-tracing, scene graph, octree, 3D sorting etc. We try to simplify the burden by taking a different approach. How it works First, we draw the colorful virtual world. Second pass, each object is draw in back ground rendering. In Fig.(\ref{2ndpass}), they may look like the same. But each of them is drawn with a unique mono-chrome color. We click the 2D pane, get a pixel position, the pixel position gives a unique color in format like [0,15,243,255], a 4 byte RGBA color. The color is mapped to a unique object ID. Discussion This article is not peer reviewed. If you find some errors or you want to give some comments, please contact the author.
	Project Friends Torus Demo1.1 I Simple GLCamera 20130731 How to: Download FriendsTorusDemo1.1.zip md5sum: d58aed75e537b09f0d4bcce779076e8e java -jar target\friendstorusdemo1.1.jar Click/focus on the GUI's canvas pane, or just click the middle of Friends Torus Java application frame. Press F11 about six times. It will show: Mode: DEBUG SimpleGLCamera Forward, backward, adjust focal length: u/i j/k Pan camera: d/f c/v t/y; swirl up-down, left-right: g/h b/n; q/w for o_size, a/s for near_z, z/x for far_z, e/r for fovy use '1'/'!' to toggle projection use 2/3 to scale up or down delta
	Project Friends Torus Demo1.1 II GLMovingObject 20130731 How to: Download FriendsTorusDemo1.1.zip md5sum: d58aed75e537b09f0d4bcce779076e8e java -jar target\friendstorusdemo1.1.jar Click/focus on the GUI's canvas pane, or just click the middle of Friends Torus Java application frame. Upon the seventh click of F11 It will show: Mode: DEBUG GLMovingObject F11-F12:debug mode; R-Y-P:raw/yaw/pitch; Q-W-E,A-S-D,Z-X-C: pan/translate; F-G:rotate about.
	Friends Torus 31 Days Development Log 20130701-20130731 Log 20130701-20130731. Functional Requirements (20130601): - 1(OpenGL) Draw a torus, smooth shading, jogl or qt !1.1 draw axis !1.2 blank background !1.3 draw torus (not necessary) !1.4 correct orientation !1.5.0 Eclipse setup https://sites.google.com/site/justinscsstuff/jogl-tutorial-1 Linking JOGL with Project !1.5.1 Maven is set (20130607) in Eclipse, DOS also working Correct maven settings, use find the correct artifact id and version http://search.maven.org/#search%7Cga%7C1%7Cgluegen !1.5.2 down load jogl 2.0-rc11 source C:\jogamp-all-platforms\jogl-java-src.zip C:\Users\graphics\Desktop\jogamp-all-platforms-20130608\jogamp-all-platforms !1.5.3 License header /* * Header-1 * @author Zhikai Wang/www.heteroclinic.net * Science and technology promotion license applied (third party licenses automatically cascaded). * Non-commercial usage of this file is not limited (Zhikai Wang/www.heteroclinic.net's rights). * Commercial usage is allowed, given this file is not modified. Inheritance/overriding/re-factoring is suggested at higher level. * This is a good-will software. Users' liability always. * (c) Zhikai Wang/www.heteroclinic.net * / / * Header-2 * @author Zhikai Wang/www.heteroclinic.net * 1. Zhikai Wang/www.heteroclinic.net originally designed/implemented a Objected-Oriented 4-by-4 matrix prototype * MovingObject. This prototype aims to ease the study of 3D object and multi-rigid body 3D transformation. * 2. Zhikai Wang/www.heteroclinic.net originally designed/implemented FriendsTorus, a visualization tool for social network. * Given you acknowledge 1 and 2, you can do anything at good-will with this software. */ 1.6 Move qt GL/math stuff to Java ^1.6.1 Reuse demo Gears as the new platform. Use the old Friends Torus main ! 1.6.1 Matris operation is feasible GLMathPoint gpt = new GLMathPoint(1f,1f,1f); gpt.testGefvetc(arg0); ((GLMatrixFunc) gl).glGetFloatv(GL2.GL_MODELVIEW_MATRIX, data1); !1.6.2 Threading test results: Main Thread.currentThread().getId():1 init(GLAutoDrawable drawable) Thread.currentThread().getId():20 reshape Thread.currentThread().getId():20 display Thread.currentThread().getId():20 mousePressed Thread.currentThread().getId():20 mousePressed Thread.currentThread().getId():20 mousePressed Thread.currentThread().getId():20 mousePressed Thread.currentThread().getId():20 mousePressed Thread.currentThread().getId():20 mousePressed Thread.currentThread().getId():20 windowClosing Thread.currentThread().getId():25 X1.6.3 gluUnProject !1.6.3.1 glu = new GLU(); //can be a member variable init in init !1.6.3.2 http://www.java-tips.org/other-api-tips/jogl/how-to-use-gluunproject-in-jogl.html !1.6.3.2.1 Fixed compiling errors X1.6.3.2.2 To be integrated with FriendsTorus (20130610, not successful). http://www.opengl.org/sdk/docs/man2/xhtml/gluUnProject.xml given up, because you still have to do depth test. !1.6.4 Gears mouse event (20130610) !1.6.4 MathPoint3 (20130611) !1.6.5 MathVector3 (20130611) !1.6.6 net.heteroclinic.multipasscolorindicescollisiondetection (20130611) ! - 1.6.6.0 Get a pixel's color in byte (looks good enoug) http://www.java-gaming.org/index.php/topic,5386. !1.7 Silent render !!! 1.7.1 SilentRender.java PBuffer works (20130613) Integrating GLPbuffer and Java Graphics2D https://today.java.net/pub/a/today/2008/10/30/integrating-glpbuffer-and-graphics2d.html jogl offscreen ThePBuffer.java in test package !1.7.1.1 Multihtreading save image works (20130714) !1.7.2 Given up (Pbuffer works, stop trying FBO) TestFBOOffThreadSharedContextMix2DemosES2NEWT.java (may comipled in jogl demos) !1.7.2.1 Comple v2.0-rc11 source : gluegen, jogl and jogl-demos http://jogamp.org/deployment/v2.0-rc11/archive/ !1.7.2.2 Comple v2.0-rc11 source : gluegen, jogl and jogl-demos done (20130715) !1.7.2.3 Re-pickup as SilentOffscreenRender in package net.heteroclinic.friendstorus.test; !1.7.2.3.1 Main reached the bottom. // agent thread and display thread are the same. agent threaid 9 display threaid 9 Info: GLReadBufferUtil.readPixels: pre-exisiting GL error 0x500 pool-1-thread-1 reached the bottom ! 1.7.2.3.2 The error: "Info: GLReadBufferUtil.readPixels: pre-exisiting GL error 0x500 " If we use Gears, there is no error. The error comes from here DetectableCuboid dc1 = new DetectableCuboid(new MathPoint3(0f, 0f, 0f)); dc1.setColorindex(new GLColoria(0, 0, 255, 255)); dc1.drawDetectable(drawable); in drawDetectable there is glEnd which has no glBein !!!1.7.2 multi-thread silent FBO render sub project finished. (20130716) 1.8 Two pass mouse click detect (no long try with unsigned integer color and alpha, working set: CollisionTestMain and printColorofAPixelinByteRGB) (20130618) !1.8.1 Class Color4ub works !1.8.2 Pbuffer test only the first object detected. That is because the bytes are not properly masked. 1.8.3 Foreground draw !1.8.3.0 new FrienTorus, new GLEventListener !1.8.3.1 GLMaterial (20130618) !1.8.3.2 Cuboid + material, X1.8.3.2.1 glInterleavedArrays(GL_T2F_V3F, 0, data); glDrawArrays(GL_QUADS, 0, 4); 1.8.4 Background(silent/offscreen) draw !1.8.4.0 BitShiftTest (20130620) !1.8.4.1 Collection[Color, Detectable] for detectable and drawable !1.8.4.2 Second-pass snapshot !1.8.4.3 Color detection Three event listener all use the same thread. SecondpassFriendsTorusGLEventListener display tid=20 SecondpassFriendsTorusGLEventListener display tid=20 ClickedColorGLEventListener display tid=20 1.10 Texture ! 1.10.1 twelve photos (Transaction ID: 51C63FFE128F8837D3586AFEAC5DE32CA12E5381 ) ! 1.10.1.0 cut the image from shuttstock into small(distinct person icon) pngs or jpgs (4018x4051 - 8x7) 500 x 579 ! 1.10.1.1 build icon00001.png to icon00051.png using net.heteroclinic.friendstorus.test.Iconbuilder ! 1.10.2 photo on cuboid as texture (201306233am) ! 1.10.2.1 texture coord ! 1.10.2.2 photo rim (20130623) !1.10.3 Texture collection X1.10.3.1 Collection init in listener init INIT cannot be done in listener's init(), can be called from a display function !1.10.3.2 Ditribute textures for PhotoCuboid objects 1.10.4 detectable ID or object name sided text !1.9 Mouse Event !1.9.1 Click object (201306223am) !!! 1.9.2 Rotate torus (20130623-11:54pm) ! 1.9.2 Rotate torus to change rotate about (0,0) to rotate about (w/2,h/2) !1.10 draw text (An acceptable result acquired on 30130630) !1.10.1 draw hints -click photo frame -drag the mouse to rotate !1.10.2 If click changed photo frame (default negative one, show title of PhotoCuboid); if the currenttime - timestamp > 10s change back to -1) !1.10.2.1 photocuboid + title X1.10.2.2 show title at correct position need porting qtWgon's matrix stuff X1.10.2.2.0 port MathMatrix from qtWagon to Java (20130629) X1.10.2.2.1 engaging gl_pixel_Position = gl_ProjectionMatrix view_matrix * model_matrix * gl_3d_Vertex; Xhttp://www.songho.ca/opengl/gl_transform.html -- give up, given current time limt, it is not possible. leave to the future research. X1.10.3 Refering TextCube demo approach X1.10.3.0 proper init of TextRenderer renderer X1.10.3.1 need a better way to calculate textScaleFactor, give up at this phase. REMARK: July 1st, 2013 deadline passed. Force demo 1.0 without Facebook API etc. 1.11 PhotoCuboid's orientation (20130708) 1.11.1 PhotoCuboid's front vector should be the negative of view vector's projection on x-y plane 1.11.1.1 Camera class !1.11.1.1.0 Port Orientation class from QtWagon to FriendsTorus (20130709) !1.11.1.1.1 Port GLOrientation class from QtWagon to FriendsTorus !1.11.1.1.2 GLEventListener for floating OP tests Notes.1 FloatBuffer.allocate(16); //return HeapFloatBuffer extends FloatBuffer Notes.2 Test case of floating OPs in class SimpleFloatingOPsGLEventListener 1.11.1.1.1 and 1.11.1.1.2 are partially done (20130710am) !1.11.1.1.3 Test GLOrientation Result of test case III. glo5: new GLOrientation() {[0.0,1.0,0.0], [1.0,0.0,0.0], [0.0,0.0,1.0]} glo5:rotateAboutVector3(drawable, new MathVector3(1f,1f,1f), 120f); {[0.0,-5.960465E-8,1.0], [-5.960465E-8,1.0,0.0], [1.0,0.0,-5.960465E-8]} !1.11.1.1.3.0 KeyAdapter FloatingOPsKeyAdapter in SimpleFloatingOPsGLEventListener (20130714) public void keyTyped (KeyEvent e){ char c = e.getKeyChar(); switch (c) { case 'c' : System.out.println("c"); break; case 'C' : System.out.println("C"); break; default: } !1.11.1.1.4 MovingObject Interface (20130715) !1.11.1.1.5 GLMovingObject (20130717) ! 1.11.1.1.5.0 Debug mode == 7 , show text in screen ! 1.11.1.1.5.1 Rotate about a vector at a point ! 1.11.1.1.5.1.0 Draw a translucent disk (replaced with a circle ) and show pivot We spent much time studying how to project a point to a line defined by a vector and a point. This also gives us better understanding of ray tracing and implement it in the future . MovingObject is critical and fundamental research for Camera implementation.(20130720) 1.11.1.1.6 SimpleGLCamera (restrict passing north pole) !1.11.1.1.6.1 Apply projection, apply lookat, lookat_up (20130727) !1.11.1.1.6.2 Orthogonal debug (20130727) !1.11.1.1.6.3 Persepective debug (20130727) !1.11.1.1.6.4 Pans: left/right-up/down-levelforward/levelbackward, orientation will not change, lookat point changes (20130727) ! 1.11.1.1.6.4.0 pinAPointAndKeepUpOrthogonal (20130729) used to initialize SimpleCamera debug GLMovingObject function pinAPointAndKeepUpOrthogonal (GLAutoDrawable drawable, MathPoint3 target) // namely align front with the view vector !1.11.1.1.6.5 forward/backward, show lookat, adjust lookat radius. (20130730) !1.11.1.1.6.6 Swirl up/down left/right. lookat wont change, orientation changes (20130731) !1.11.1.1.6.6.0 North pole restrict checking is wrong, fixed (20130731) REMARK: July 31st, 2013 deadline passed. Force demo 1.1. ======= BACKLOG ============ 1.11.1.1.6.7 viewVector 1.11.1.2 set orientation of cuboid correctly according to view vector 1.11.1.1.4 Port Camera from QtWagon 1.11.1.1.5 Test Camera 1.11.2 Text should be mapped to the pixel world (2d) position, why? it makes textScaleFactor easy to control, in demo 1.0, we see the text rendered aliased in 3d rendering. 1.11.1.1.5.1.1 Project a point to a surface defined by point and a vector. 1.11.1.1.5.1.1 Find the intersection point between a line and and a surface (ray tracing). Just 3D. 1.9.3 Camera 1.9.3.1 Transfer glMovingObject from QT 1.9.3.2 Correct orientation X1.9.3.3 class VerifyAngleBetween. floating point OP sequences give different result, not directly related to this project, but interesting?? 2.0 Facebook Java API http://restfb.com/# 1.10 New License Header + Mouse detection 1.11 Alpha 1.0 (GL part and UI part finish estimated b4-20130623) 1.6.10 Maven repo website http://maven.apache.org/guides/introduction/introduction-to-repositories.html http://maven.apache.org/guides/introduction/introduction-to-repositories.html net.heteroclinic.multipasscolorindicescollisiondetection should cs and put in - 2(Algorithmic) Parse friend from xml (id, First Name, Last Name, photo file, description text). - 3-1 Put friends in the Torus, friend at proper location. 3-2 - 4 ( may also add each friend's connections) - 5 Connect to facebook or Linkedin - 6 TBD Non-functional Requirements - mvn project - Deploy in JBoss - Web API * Deadline July 1st X http://eclipse-opengl.sourceforge.net/ X C:\Users\graphics\Desktop\jogl-master.zip ! all jogl source refer to C:\Users\graphics\Desktop\joamap * Must complete ! completed - TODOs