Of all the technical session and talks I went to today the topic that was the most exciting was the “ArcGIS Maps for Adobe Creative Cloud”. The plugin for Adobe Creative Cloud is a bridge between ArcGIS and Adobe Illustrator and Photoshop. This plugin allows cartographers and graphics designers to import vector and raster data directly from ArcGIS Online and from shapefiles into Illustrator and Photoshop. Once these data are in Illustrator and Photoshop the data can be manipulated and styled using the native tools in Illustrator and Photoshop.
This tool fills a need that cartographers have wanted filled for many years. I foresee these tools as being very important to allow graphics designers within our organization to extend the spatial data that we have created to publications and other materials that UCANR produce.
To download and start using these tools you will need access to Adobe Creative Cloud https://exchange.adobe.com/addons/products/16913 and an ArcGIS for Organizations account http://www.arcgis.com. If you are a member of the UCANR network and do not have access to ArcGIS Online fill out the following form and we will help you gain access to the ArcGIS Online http://igis.ucanr.edu/resources/esri_software/.
Notes and stray thoughts:
- ArcGIS Pro 2.0 and ArcGIS 10.5.1 Released in advance of the User Conference this year. To see what is new in these new releases go to http://pro.arcgis.com/en/pro-app/get-started/whats-new-in-arcgis-pro.htm for ArcGIS Pro 2.0 and http://desktop.arcgis.com/en/arcmap/latest/get-started/introduction/whats-new-in-arcgis.htm#ESRI_SECTION1_76DF146740D047C78D38DC5FFF917CCD for ArcGIS 10.5.1.
- ArcGIS Pro and ArcGIS will be have new releases every 6 months in to the future.
- As always, the ESRI User Conference is a well done production with professional presentation and branding.
- Being at the ESRI Conference is always a nice opportunity to see old friends in the GIS community.
More to Come Tomorrow
It's that time again! The worlds largest GIS User Conference has returned for its 38th year and the first two days have been jam packed with content. This is my fourth time attending, and I'm always a bit surprised by how much the conference seems to have grown every time I come down. This year's attendance is around 16,000 people and it shows! The halls of the San Diego convention center are filled with an unbelievable human tide and I've been in a couple of sessions that were standing room only.
The first day's plenary session was quite a production as usual, but was lacking in the type of big announcements of new software or major updates that have been the norm in years past. Highlights included a look at how Disney Imagineers developed the city of Zootopia using Esri's CityEngine software and a thought-provoking keynote address from Dr. Geoffrey West about the growth cycles of biological organisms and their links to the development of urban areas.
Some highlights from Day 2 included a session on the continued integration of Python and R into the ArcGIS Desktop environment, particularly ArcGIS Pro. The closest thing I've seen to a major announcement so far is that raster support is coming to the R-ArcGIS Bridge with the release of ArcGIS Pro 2.1. I also atteneded a session on Esri's Drone2Map software which looks like a simplified version of Pix4D which has been very nicely integrated with ArcGIS Pro. I think the biggest takeaway from these first days has been that I really need to start seriously working on migrating to ArcGIS Pro!
I look forward to what's in store for the rest of the week. Stay tuned for more updates!
Esri has been holding these Imagery and Mapping Forum days prior to the main UC. I was here for the day, as an invited panelist for the Executive Panel and Closing Remarks session on Sunday. During the day Ihung out in the Imaging and Innovation Zone, in front of the Drone Zone (gotta get one of these for ANR).
Notes from the day: Saw demos from a range of vendors, including:
- Aldo Facchin from Leica gave a slideshow about the Leica Pegasus: Backpack. Their backpack unit workflow uses SLAM; challenges include fusion of indoor and outdoor environments (from transportation networks above and below ground). Main use cases were industrial, urban, infrastructure. http://leica-geosystems.com/en-us/products/mobile-sensor-platforms/capture-platforms/leica-pegasus-backpack
- Jamie Ritche from Urthecast talked about "Bringing Imagery to Life". He says our field is "a teenager that needs to be an adult". By this he means that in many cases businesses don't know what they need to know. Their solution is in apps- "the simple and the quick": quick, easy, disposable and useful. 4 themes: revisit, coverage, time, quality. Their portfolio includes DEIMOS 1, Theia, Iris, DEIMOIS-2, PanGeo + . Deimos-1 focuses on agriculture. UrtheDaily: 5m pixels, 20TB daily, (40x the Sentinel output); available in 2019. They see their constellation and products as very comparable to Sentinel, Landsat, RapidEye. They've been working with Land O Lakes as their main imagery delivery. Stressing the ability of apps and cloud image services to deliver quick, meaningful information to users. https://www.urthecast.com/
- Briton Vorhees from SenseFly gave an overview of: "senseFly's Drone Designed Sensors". They are owned by Parrot, and have a fleet of fixed wing drones (e.g. the eBee models); also drone optimized cameras, shock-proof, fixed lens, etc (e.g. SODA). These can be used as a fleet of sensors (gave an citizen-science example from Zanzibar (ahhh Zanzibar)). They also use Sequoia cameras on eBees for a range of applications. https://www.sensefly.com/drones/ebee.html
- Rebecca Lasica and Jarod Skulavik from Harris Geospatial Solutions: The Connected Desktop". They showcased their new ENVI workflow implemented in ArcGIS Pro. Through a Geospatial Services Framework that "lifts" ENVI off the desktop; and creates an ENVI Engine. They showed some interesting crop applications - they call it "Crop Science". This http://www.harrisgeospatial.com/
- Jeff Cozart and McCain McMurray from Juniper Unmanned shared "The Effectiveness of Drone-Based Lidar" and talked about the advantages of drone-based lidar for terrain mapping and other applications. They talked through a few projects, and wanted to demonstrate the economies for drone-based lidar. The main advantages are in the data, not in the economics per se. They partner with Reigl and YellowScan from France. Showcased an example in Colorado between lidar (DJI Matrice was platform) and survey - the cost was 1/24th as expensive as the field survey. They did a live demo of some of the ArcGIS tools: classification of ground, feature extraction, etc. http://juniperunmanned.com/
- Aerial Imaging Productions talked about their indoor scanning - this linking indoor to outdoor - making data truly geo - is a big theme here. Also OBJ is a data format. From Wikipedia: "The OBJ file format is a simple data-format that represents 3D geometry alone — namely, the position of each vertex, the UV position of each texture coordinate vertex, vertex normals, and the faces that make each polygon defined as a list of vertices, and texture vertices." Used for 3D graphics, but increasingly for indoor point clouds in our field.
- My-Linh Truong from Reigl talked about their new static, mobile, airborne, uav lidar platforms. They've designed some mini lidar sensors for smaller UAVas (3lbs; 100kHz; 250m range; ~40pts/m2). Their ESRI workflow is called LMAP, and it relies on some proprietary REIGL software processing at the front end, then transfer to ArcGIS Pro (I think). http://www.rieglusa.com/index.html
We wrapped up the day with a panel discussion, moderated by Esri's Kurt Schwoppe, and including Lawrie Jordan from Esri, Greg Koeln from MDA, Dustin Gard-Weiss from NGA, Amy Minnick from DigitalGlobe, Hobie Perry from USFS-FIA, David Day from PASCO, and me. We talked about the promise and barriers associated with remote sensing and image processing from all of our perspectives. Some fun things that came out of the panel discussion were:
- Lawrie Jordan started Erdas!
- Digital Globe launched their 30cm resolution WorldView-4. One key case study was a partnership with Associated Press to find a pirate fishing vessel in action in Indonesia. They found it, and busted it, and found on board 2,000 slaves.
- The FIA is increasingly working on understanding uncertainty in their product, and they are moving for an image-base to a raster-based method for stratification.
- Greg Koeln, from MDA (he of the rad tie) says: "I'm a fan of high resolution imagery...but the world is a big place".
- Multi=sensor triangulation (or georeferencing a stack of imagery from multiple sources to you and me) is a continual problem, and its going to get worse before it gets better with more imagery from UAVs. On that note, Esri bought the patent for "SIFT" an automated tool for relative registration of an image stack.
- Space Junk!
Notes and stray thoughts:
- Esri puts on a quality show always. San Diego always manages to feel simultaneously busy and fun, while not being crowded and claustrophobic. Must be the ocean or the air.
- Gotta get behind the ubiquitous "analytics" replacement of "analysis" in talks. I am not convinced everyone is using the term correctly, but hey, it's a thing now: https://en.wikipedia.org/wiki/Analytics#Analytics_vs._analysis
- 10 years ago I had a wonderful visitor to my lab from Spain - Francisco Javier Lozano - and we wrote a paper: http://www.sciencedirect.com/science/article/pii/S003442570700243X. He left to work at some crazy company called Deimos in Spain, and Lo and Behold, he is still there, and the company is going strong. The Deimos satellites are part of the UrtheCast fleet. Small world!
- The gender balance at the Imagery portion of the Esri UC is not. One presenter at a talk said to the audience with a pointed stare at me: "Thanks for coming Lady and Gentlemen".
Good fun! Now more from Shane and Robert at the week-long Esri UC!
UC ANR was a sponsor for the FOODIT: Fork to Farm meeting in June 2017: http://mixingbowlhub.com/events/food-fork-farm/. Many of us were there to learn about what was happening in the food-data-tech space and learn how UCANR can be of service. It was pretty cool. First, it was held in the Computer History Museum, which is rad. Second, the idea of the day was to link partners, industry, scientists, funders, and foodies, around sustainable food production, distribution, and delivery. Third, there were some rad snacks (pic below).
We had an initial talk from Mikiel Bakker from Google Food, who have broadened their thinking about food to include not just feeding Googlers, but also the overall food chain and food system sustainability. They have developed 5 "foodshots" (i.e. like "moonshot" thinking): 1) enable individuals to make better choices, 2) shift diets, 3) food system transparency, 4) reduce food losses, and 5) how to make a closed, circular food system.
We then had a series of moderated panels.
The Dean's List introduced a panel of University Deans, moderated by very own Glenda Humiston @UCANR, and included Helene Dillard (UCDavis), Andy Thulin (CalPoly), Wendy Wintersteen (Iowa State). Key discussion points included lack of food system transparency, science communication and literacy, making money with organics, education and training, farm sustainability and efficiency, market segmentation (e.g. organics), downstream processing, and consumer power to change food systems. Plus the Amazon purchase of Whole Foods.
The Tech-Enabled Consumer session featured 4 speakers from companies who feature tech around food. Katie Finnegan from Walmart, David McIntyre from Airbnb, Barbara Shpizner from Mattson, Michael Wolf from The Spoon. Pretty neat discussion around the way these diverse companies use tech to customize customer experience, provide cost savings, source food, contribute to a better food system. 40% of food waste is in homes, another 40% is in the consumer arena. So much to be done!
The session on Downstream Impacts for the Food Production System featured Chris Chochran from ReFed @refed_nowaste, Sabrina Mutukisna from The Town Kitchen @TheTownKitchen, Kevin Sanchez from the Yolo Food Bank @YoloFoodBank, and Justin Siegel from UC Davis International Innovation and Health. We talked about nutrition for all, schemes for minimizing food waste, waste streams, food banks, distribution of produce and protein to those who need them (@refed_nowaste and @YoloFoodBank), creating high quality jobs for young people of color in the food business (@TheTownKitchen), the amount of energy that is involved in the food system (David Lee from ARPA-E); this means 7% of our energy use in the US goes to CREATING FOOD WASTE. Yikes!
The session on Upstream Production Impacts from New Consumer Food Choices featured Ally DeArman from Food Craft Institute @FoodCraftInst, Micke Macrie from Land O' Lakes, Nolan Paul from Driscoll's @driscollsberry, and Kenneth Zuckerberg from Rabobank @Rabobank. This session got cut a bit short, but it was pretty interesting. Especially the Food Craft Institute, whose mission is to help "the small guys" succeed in the food space.
The afternoon sessions included some pitch competitions, deep dive breakouts and networking sessions. What a great day for ANR.
So much to learn! Here is my distillation of the main take-homes from last week.
Notes about the workshop in general:
- Making participants do organized homework and install software is necessary for complicated workshop content: http://neondataskills.org/workshop-event/NEON-Data-Insitute-2017
- NEON used tips from software carpentry workshops, particularly the green-and-pink sticky tag tip. When you put up a pink sticky on your computer, you need help; when you put up a green sticky on your computer, you are all good. This makes everything go smoother and means participants don't have to hold up their hand to get attention.
- Having lots of helpful, friendly faces around to help during the coding bits, and having access to the code when you got behind was critical.
- The workshop content and daily schedule:
NEON data and resources:
- All the NEON airborne data can be found here: http://www.neonscience.org/data/airborne-data
- For more on when data rolls out, sign up for the NEON eNews here: http://www.neonscience.org/
Other misc. tools:
- For cleaning messy data - check out OpenRefine - a FOS tool for cleaning messy data http://openrefine.org/
- Excel is cray-cray, best practices for spreadsheets: http://www.datacarpentry.org/spreadsheet-ecology-lesson/
- Morpho (from DataOne) to enter metadata: https://www.dataone.org/software-tools/morpho
- Pay attention to file size with your git repositories - check out: https://git-lfs.github.com/. Git is good for things you do with your hands (like code), not for large data.
- Markdown renderer: http://dillinger.io/
- MIT License, like Creative Commons for code: https://opensource.org/licenses/MIT
- There is a new project called "Feather" that allows compatibility between python and R: https://blog.rstudio.org/2016/03/29/feather/
- All the NEON airborne data can be found here: http://www.neonscience.org/data/airborne-data
- Information on the TIFF specification and TIFF tags here: http://awaresystems.be/, however their TIFF Tag Viewer is only for windows.
- All NEON point cloud classifications are done with LASTools. Go LASTools! https://rapidlasso.com/lastools/
- Check out pdal - like gdal for point clouds. It can be used from bash. Learned from my workshop neighbor Sergio Marconi https://www.pdal.io/
- Reflectance Tarps are made by GroupVIII http://www.group8tech.com/
- ATCOR http://www.rese.ch/products/atcor/ says we should be able to rely on 3-5% error on reflectance when atmospheric correction is done correctly (say that 10 times fast) with a well-calibrated instrument.
- NEON hyperspectral data is stored in HDF5 format. HDFView is a great tool for interrogating the metadata, among other things. https://support.hdfgroup.org/products/java/hdfview/