Links to Software: Walloftext.co/weirdworlds
1) Maxon Cinema 4D R20 installieren und mit Perspectiven anfreunden + Shortkeys lernen

2) Nächste Session: Photogrammetrie (möglich Objekt mitzubringen)

3) Überlegen was man Photogrammetrieren könnte und ggf. erste Experimente machen

4) Von zuhause Microsoft Computer für rendern mitnehmen!
Aufgabe / To Do
Japanische Monster Kaiju toys ?
Anime toys?
Forest objects?

>> ended up photographing
Mushrooms
Flowers
The process: Featurepoint > point cloud > mesh > textur

geeignete Objekte:
- bewegungslose Szene
- stabile Lichtverhältnisse
- vermeiden von transparentem oder glänzendem Material
- keine zu dünnen Gegenstände
- Vermeidung von harten Schatten
- texturreicher Hintergrund

Wie shootet man am besten - Kameraeinstellung

RAW (zu groß)oder jpg.
Manuelle Settings

Scharfe Bilder:
offene Blende
kurze Verschlusszeit
(um motion blur zu vermeiden)
Hohe ISO mit noise is ok weil die Qualität nicht so wichtig ist aber Eckpunkte

60-80% Überlappung
weiter weg - näher ran
> Meshroom für Windows
> Colmap für Mac

> + Trnio für Iphone!
Im Kurs
1) Fotos machen
2) Meshroom zum ersten mal benutzen - troubleshooting

Für nächstes treffen
1) Ein Bild welches für camera mapping geeignet ist shooten: Hierfür sind besonders gut erkennbare geometrische Formen gut, so wie Häuser oder Möbel z.B. Rectangles
Aufgabe / To Do
st Test
The initial mesh shows the area surrounding the flower better than anticipated

The texture / material detail of the flower is quite good, even with a data set of 45 images.
The flower can be easily isolated by deleting unwanted parts of the mesh.

Remind me of this work (In Meshroom I could easily take away the coloration and make it white); which could lead to a series of flowers that look almost crystallised in white.
Sidenote that isen't really important here but if I would create a digital piece like this is would be interesting to create a physical pendant to it e.g. 3D printing of 3D flower sculptures..
By digitalising physical things it becomes easy to create a mash-up and stitch together things that actually don't belong..which reminds me of the anomaly patchwork creations of 'Annihilation'.

It might be interesting to create some kind of photogrammetry patchwork of things that don't belong together.
Prinzip genau anders rum; man nimmt ein Photo und macht daraus ein 3D environment
Photogrammetry
Camera (projection) Mapping
Let direction arise from things I find or create a concept and direction by creating with intention?


Making as Design Research
When thinking about collecting objects I immediately think of Stina's collection shrine
and how similar found (digitalised) objects could act as portals to certain stories or spaces..
Photogrammetry Mesh reduzieren
TO DO:
Eigenes Photogrammetry Model erstellen in Meshroom und mitbringen ! !
Camera mapping - Tutorial
Re-do Camera mapping: choose a suitable object and 3D map it! Especially 8-18min.
In Cinema 4D animieren & raus rendern
Flat image Tutorial
'Tutorial - Cinema 4D Projection Man Intro - Part 1'
Flat image Tutorial
'Cinema 4D Introduction to ProjectionMan'
Unsolved:
Which file is Meshroom and can reopen the working project file?
UVW tag? - How to glue Projection to object?
How to change quality of the render view in Cinema 4D?

Solved:
_Make sure project setting is scaled to image size
_If problem uploading image with image rotation - export and import as TIFF
_ Camera animation works with setting Keyframes in different spots while recording with one camera; different from Coordinate placement when moving Object.
How can scans be reduced and modified for further use?
Trnio app vs. Recap photo vs. Meshroom
Photogrammetry- Tutorial
The finished meshs fully textured in Meshroom
It is much more difficult to view the mg. file on the Lenovo I have at home + the computer's processor is not capable of rendering the photogrammetry meshes.
From the offered dataset of 82 images only 31 could be used, presumably due to obstruction through grass, twigs and sharpness vs. blur. Still incredible that from 31 ( the one above 26) images such a detailed mesh was created.
This point-cloud of large colourful dots also looks very interesting - reminds of the http://iteota.com/ project , that showed the woods in colourful dots - could a loop from the full textured mesh to the dots be rendered out?
Front
Back
These results remind be of 3 things:

1) how in a dream only the thing the dreamer is focusing on has to be in focus

2) how in quantum physics the thought experiment of 'Shordingers Cat' and Solipsism (/ˈsɒlɪpsɪzəm/ (About this soundlisten); from Latin solus, meaning 'alone', and ipse, meaning 'self')[1] is the philosophical idea that only one's mind is sure to exist. As an epistemological position, solipsism holds that knowledge of anything outside one's own mind is unsure; the external world and other minds cannot be known and might not exist outside the mind.
: this idea that if things don't enter my consciousness they don't exist and only materialise once they enter my consciousness.
Therefore that which is not seen does not need to be rendered.

3) In a way these rounded blobs of digitally rendered reality are like 'Seifenblasen' that briefly capture and reflect a moment in time. This could also be seen as an imaginative analogy to why photogrammetry seems to have the biggest effect with scenes and people scans.
Week 4
Week 5
Vortrag Dienstag 21.11 - 19 uhr
Workshop Mittwoch 27.11 9-12 uhr

Dienstag 7.01 15:00 anstatt 9.01
Mittwoch 15.01 10-12 anstatt 16.01

Open Lab Montag 2.12 - 17:00 - 19:00 Uhr
Retopology

Reduktion von hoch aufgelösten 3D Modelle durch die Erstellung einer neuen, simplen Meshkopie

100.000 punkte max. in einer App (AR)

Einfacheres UV-Unwrapping

UV Unwrapping aesthetic - unusual portrait
Intuitively starting with the mushrooms - without a concept- only because I am drawn to them is the working method approach we talked about that leads you to unexpected - unplanned outcomes...
The question that also poses itself is: Wann lohnt sich Photogrammetry überhaupt?'

1. Complex shapes or compositions
2. Very organic objects (non reflective)
3. People
4. Rooms /Spaces
Week 6
Für Import zu Unity -

Model umbenennen - Material umbenennen
im Poligon modul - rechtsclick- mesh triangulieren

als FBX speichern



In Unity - mit timeline - Sachen mit Keyframes bestimmen
Oder mit Physics/Dynamics und Code bzw. Regeln

Unity ist für interactive Systeme -
Pile of plates and shrubs at mediamatic

https://nikitadiakur.com/

Ian Cheng - neurology studiert - gibt Objekten eigene Verhaltensweise - spiel was sic selber spielt - kein Anfang - kein Ende

rocks sinking - was für Eigenschaften hat ein Objekt.

eigenes system - irritation , weil es nie aufhört - Kamera wechselt automatisch hin und her



> Think about what kind of characteristics objects could have - how they could act
Learning moment - insights so far

Camera mapping needs dimensionality - vanishing point - depth ; could work with flat imagery with slightly other technique


photogrammetry works best on larger free standing objects - the smaller the object the more difficult

any shiny or transparent or reflective surfaces create distortion
Comparison: what is best for photogrammetry?
App: Trnio
Windows: Meshroom
Windows: Recap Photo
App: Display.land
Homework
Create loop object and export as fbx with animation to import into Unity
View from computer-scientist:

kinect leads to Depth Maps
other categories are point cloud and triangle meshes

kinect eg. um Avatare zu kreieren
Real sense -farb & tiefen sensor
motion sensor - Leap motion ; good for hand tracking - could be e.g. built onto head piece
ARTrack (infrarot tracking) > Echtzeit im Raum tracken
4k3d projectors
HMDs

AFrame - Html, Javascript used for creating a synthesiser in Webbrowser - alternative zu unity oder script - modele (obj) rein laden & im browser positionieren - link schicken um jmd. anderen bearbeiten lassen - A-Frame berechnet im Browser und ist im default für VR geeignet

Man can Unity als WebGL exportieren

Mediaenvironment BioGame

Problem in VR Bewegung ohne awareness für Umfeld

Substancce Painter - photoshop für 3D Objekte !!!
Quixel Megascans - HD 3D scans (now bough Unreal - and for free if you have Unreal engine) > get Unreal ! but HUGE models so might not be computationally usefull.
Sonderzeichen raus unter_score is ok
alles unnötige löschen
Achse auf Mittelpunkt von Objekt

Unity can nur UVW coordinaten lesen für Texturen

select object ( not texture frame) and select Object > Bake Object
name everything properly
export as png or jpg

after baking texture export as fbx - neuste fbx version

normale
triangulierung geometrie
texturen und materialien texturen einbtetten

cinema export - wenn man animation hat 'spuren' aktivieren

Once inside Unity:

for animation
> animator controller von right click place in animator viel in component window > then dopple click and place animation clip into base layer
Open OBJ in Cinema - edit to have as you like and save as
First file - original full model: Roundrock

First Cinema4d export as OBJ save edited as 'form': Roundrockform

The OBJ from Instantmeshes will be called 'mesh: Roundrockmesh

Neues mesh in Cinema4d als Lowpolymesh benennen
Nach UV unwrapping C4D file saven mit assets - 'RoundrockUVU'

Baked PSD 'Roundrockbaked'

OBJ with reduced mesh and baked texture reapplied: 'final: Roundrockmeshfinal

Cinema4dfile: Roundrockreduced
Drive
Export for Unity guidelines
Cinema 4D -How to name files agenda:
Tutorial:
https://www.youtube.com/watch?v=BNNesTZrmJg - Cinema 4D to Unity - How to export materials and animations
Steps I need to take for each rock model
1) Scan using Trnio App or photograph

2) inside Cinema4d Camera Map or Retropology of Mesh > meaning edit and reduce mesh by making out the texture

incl. adding animation - adjusting aches etc.

3) prepare and export for Unity with UVW coordinate texture baked on model

Retopology - Reducing Mesh - UV unwrapping and baking out the texture
Reduktion von hoch aufgelösten 3D Modellen durch die Erstellung einer neuen, simplen Meshkopie
I will one of the camera mapped rocks and have it tumble over to it's side and roll like a dice.
To complete the models and give them a button Blender as modeling software might be most suited? 
Without direct comparison of results right now Trio App is winning because it's FAST, EASY and gives DIRECT RESULTS.

Even if the quality rendered from one of the other softwares was better WHICH I DOUBT with the amount of rocks I am compiling fast and convenient might be the way to go.
What is more computationally heavy? To create an animation in Cinema4D or in Unity because I think I prefer to load unanimated models into Unity and create the animation there? 
1st was in class fbx and texturing worked - no animation included

2nd fbx with animation - texturing worked but were is the animation? 

3rd fbx without animation - texturing didn't work?
Should the texture that I bake out for the fbx be higher resolution to make sure my object has a higher resolution ???