A variety of open source projects have been integrated, tested and combined as part of the Hortonworks Data Platform (HDP). The platform components comprising the Hortonworks Data Platform (HDP) are released under the Apache 2.0 License. HDP is also commonly used with 3rd-Party Components (ex. Oracle’s JDK – Java Platform) and Optional Add-Ons (ex. Hive ODBC Driver). When you choose to use those components, it is recommended you read and understand the licensing terms specific to each of those components.
Does anyone know where I can find a 32-bit version of Winutils.exe? I have written some unit tests using the Mini Accumulo Cluster(MAC) and they need this file. I have found several places that have a 64-bit version of this file, but I can’t find a 32-bit one. A colleague of mine is stuck on Window 7 32-bit.
- Apache Spark on Windows 7. Download and install winutils.exe and place it in any location in the D drive. Actually, the official release of Hadoop 2.6 does not include the required binaries (like winutils.exe) which are required to run Hadoop. Remember, Spark is a engine built over Hadoop.
- This post enumerates the steps necessary to setup Atlas development environment using IntelliJ on Mac and Windows. This setup uses the BerkeleyDB for backend and embedded Solr as index engine. Setup with other backend and index engine variations are.
What Is Winutils
I am working on an application, which has junit test cases with org.apache.hadoop.io.SequenceFile, it gets a Writer out of it and appends some data on it.(using Hadoop 2.6.0 jar) Now this test case is running fine with my Ubuntu 18.04 and Macbook, without installing any Hadoop(I can say this because those are fresh laptop). When I run the same test case in windows it asks for winUtils.exe or hadoop.dll, after setting environment variable it runs fine.
My Question is:. How it runs fine with linux or mac os, without providing native code location or library for these platform??. Can we also bypass it in windows especially when we are not using Hadoop in our test case ( instantiating Writer object trigger this check). TL;DR: Can I setup my app to get winutils.exe from any jar or maven repo. So user doesn't have to download any external files beside JRE.