ZIPspark课程设计任务 21MB

2301_79070867需要积分:10(1积分=1元)

资源文件列表:

spark.zip 大约有61个文件
  1. spark/data.csv 65.61MB
  2. spark/FoodSpark2/
  3. spark/FoodSpark2/.idea/
  4. spark/FoodSpark2/.idea/artifacts/
  5. spark/FoodSpark2/.idea/artifacts/FoodSpark2_jar.xml 301B
  6. spark/FoodSpark2/.idea/codeStyles/
  7. spark/FoodSpark2/.idea/codeStyles/codeStyleConfig.xml 153B
  8. spark/FoodSpark2/.idea/compiler.xml 543B
  9. spark/FoodSpark2/.idea/misc.xml 541B
  10. spark/FoodSpark2/.idea/scala_compiler.xml 191B
  11. spark/FoodSpark2/.idea/workspace.xml 6.23KB
  12. spark/FoodSpark2/out/
  13. spark/FoodSpark2/out/artifacts/
  14. spark/FoodSpark2/out/artifacts/FoodSpark2_jar/
  15. spark/FoodSpark2/out/artifacts/FoodSpark2_jar/FoodSpark2.jar 27.79KB
  16. spark/FoodSpark2/pom.xml 2.7KB
  17. spark/FoodSpark2/src/
  18. spark/FoodSpark2/src/main/
  19. spark/FoodSpark2/src/main/java/
  20. spark/FoodSpark2/src/main/resources/
  21. spark/FoodSpark2/src/main/scala/
  22. spark/FoodSpark2/src/main/scala/FoodSpark/
  23. spark/FoodSpark2/src/main/scala/FoodSpark/FoodSpark.scala 6.63KB
  24. spark/FoodSpark2/src/main/scala/FoodSpark/FoodSpark2.scala 6.62KB
  25. spark/FoodSpark2/src/test/
  26. spark/FoodSpark2/src/test/java/
  27. spark/FoodSpark2/src/test/scala/
  28. spark/FoodSpark2/target/
  29. spark/FoodSpark2/target/classes/
  30. spark/FoodSpark2/target/classes/FoodSpark/
  31. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark$$anonfun$1.class 1.12KB
  32. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark$$anonfun$2.class 1000B
  33. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark$$anonfun$3$$anonfun$apply$1.class 1.17KB
  34. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark$$anonfun$3.class 1.64KB
  35. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark$$anonfun$4.class 1.2KB
  36. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark$$anonfun$5.class 1.21KB
  37. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark$$anonfun$6.class 1.33KB
  38. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark$$anonfun$7.class 1.51KB
  39. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark$$anonfun$8.class 1.79KB
  40. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark$$anonfun$main$1.class 1.3KB
  41. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark$.class 4.1KB
  42. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark.class 1KB
  43. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark2$$anonfun$1.class 1.13KB
  44. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark2$$anonfun$2.class 1004B
  45. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark2$$anonfun$3$$anonfun$apply$1.class 1.18KB
  46. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark2$$anonfun$3.class 1.65KB
  47. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark2$$anonfun$4.class 1.2KB
  48. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark2$$anonfun$5.class 1.22KB
  49. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark2$$anonfun$6.class 1.33KB
  50. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark2$$anonfun$7.class 1.51KB
  51. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark2$$anonfun$8.class 1.79KB
  52. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark2$$anonfun$9.class 1.22KB
  53. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark2$$anonfun$main$1.class 1.06KB
  54. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark2$$anonfun$main$2.class 1.3KB
  55. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark2$$anonfun$main$3.class 1.06KB
  56. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark2$.class 4.36KB
  57. spark/FoodSpark2/target/classes/FoodSpark/FoodSpark2.class 1.17KB
  58. spark/FoodSpark2/target/classes/META-INF/
  59. spark/FoodSpark2/target/classes/META-INF/FoodSpark2.kotlin_module 16B
  60. spark/FoodSpark2/target/generated-sources/
  61. spark/FoodSpark2/target/generated-sources/annotations/

资源介绍:

对数据文件data.csv在根据课程设计要求在IDEA中编写Spark程序并打包成jar包，并且将数据文件data.csv上传到HDFS中，提交jar包到Spark集群中运行。 data.csv里面包含餐厅数据，可以用记事本打开查看，主要包含以下13个字段，字段之间由逗号分隔： "所属年月","商家名称","主营类型","店铺URL","特色菜","累计评论数","累计销售人次","店铺评分","本月销量","本月销售额","城市","商家地址","电话" 课程设计要求完成以下任务，在IDEA中创建Maven项目，提供pom.xml文件给大家，完成以下任务。 一、将data.csv文件上传到hdfs的/cateringdata/目录下。 二、编写Spark程序，实现以下功能，并且将程序打包为jar包 1.去掉"本月销量","本月销售额"（第8列和第9列）的数据异常（数据为空字符串或者null或者为0），并且统计去掉了多少条；这一步清洗获得的数据要以逗号分割，存到hdfs的/foodsparktask1目录下; 2.去掉"店铺评分"数据为null的数据，并统计去掉了多少条; 3.去掉"店
<?xml version="1.0" encoding="UTF-8"?> <project version="4"> <component name="ArtifactsWorkspaceSettings"> <artifacts-to-build> <artifact name="FoodSpark2:jar" /> </artifacts-to-build> </component> <component name="AutoImportSettings"> <option name="autoReloadType" value="SELECTIVE" /> </component> <component name="ChangeListManager"> <list default="true" id="2f6761c6-62fb-48be-959b-884768030495" name="Default Changelist" comment="" /> <option name="SHOW_DIALOG" value="false" /> <option name="HIGHLIGHT_CONFLICTS" value="true" /> <option name="HIGHLIGHT_NON_ACTIVE_CHANGELIST" value="false" /> <option name="LAST_RESOLUTION" value="IGNORE" /> </component> <component name="CodeStyleSettingsInfer"> <option name="done" value="true" /> </component> <component name="MarkdownSettingsMigration"> <option name="stateVersion" value="1" /> </component> <component name="ProjectCodeStyleSettingsMigration"> <option name="version" value="2" /> </component> <component name="ProjectId" id="2hrnt4S2vdqV91WTfQqSRlO5Edh" /> <component name="ProjectViewState"> <option name="hideEmptyMiddlePackages" value="true" /> <option name="showLibraryContents" value="true" /> </component> <component name="PropertiesComponent"> <property name="last_opened_file_path" value="$PROJECT_DIR$" /> <property name="project.structure.last.edited" value="Artifacts" /> <property name="project.structure.proportion" value="0.15" /> <property name="project.structure.side.proportion" value="0.2" /> <property name="settings.editor.selected.configurable" value="preferences.lookFeel" /> </component> <component name="RecentsManager"> <key name="CopyClassDialog.RECENTS_KEY"> <recent name="FoodSpark" /> </key> </component> <component name="RunManager" selected="Application.FoodSpark"> <configuration name="FoodSpark" type="Application" factoryName="Application" temporary="true"> <option name="MAIN_CLASS_NAME" value="FoodSpark.FoodSpark" /> <module name="FoodSpark2" /> <extension name="coverage"> <pattern> <option name="PATTERN" value="FoodSpark.*" /> <option name="ENABLED" value="true" /> </pattern> </extension> <method v="2"> <option name="Make" enabled="true" /> </method> </configuration> <configuration name="Scala REPL" type="ScalaScriptConsoleRunConfiguration" factoryName="Scala Console" temporary="true" show_console_on_std_err="false" show_console_on_std_out="false"> <module name="FoodSpark2" /> <option name="allowRunningInParallel" value="false" /> <option name="javaOptions" value="-Djline.terminal=NONE" /> <option name="myConsoleArgs" value="" /> <option name="workingDirectory" value="$PROJECT_DIR$" /> <method v="2"> <option name="Make" enabled="true" /> </method> </configuration> <recent_temporary> <list> <item itemvalue="Application.FoodSpark" /> <item itemvalue="Scala REPL.Scala REPL" /> </list> </recent_temporary> </component> <component name="SpellCheckerSettings" BundledDictionaries="0" RuntimeDictionaries="0" Folders="0" CustomDictionaries="0" Dictionaries="0" CorrectionsLimit="5" DefaultDictionary="应用程序级" UseSingleDictionary="true" /> <component name="SvnConfiguration"> <configuration /> </component> <component name="TaskManager"> <task active="true" id="Default" summary="Default task"> <changelist id="2f6761c6-62fb-48be-959b-884768030495" name="Default Changelist" comment="" /> <created>1718361274808</created> <option name="number" value="Default" /> <option name="presentableId" value="Default" /> <updated>1718361274808</updated> </task> <servers /> </component> <component name="WindowStateProjectService"> <state x="634" y="250" key="FileChooserDialogImpl" timestamp="1718531781760"> <screen x="0" y="0" width="1707" height="1019" /> </state> <state x="634" y="250" key="FileChooserDialogImpl/0.0.1707.1019@0.0.1707.1019" timestamp="1718531781760" /> <state width="1663" height="274" key="GridCell.Tab.0.bottom" timestamp="1718678758041"> <screen x="0" y="0" width="1707" height="1019" /> </state> <state width="1663" height="274" key="GridCell.Tab.0.bottom/0.0.1707.1019@0.0.1707.1019" timestamp="1718678758041" /> <state width="1663" height="274" key="GridCell.Tab.0.center" timestamp="1718678758041"> <screen x="0" y="0" width="1707" height="1019" /> </state> <state width="1663" height="274" key="GridCell.Tab.0.center/0.0.1707.1019@0.0.1707.1019" timestamp="1718678758041" /> <state width="1663" height="274" key="GridCell.Tab.0.left" timestamp="1718678758040"> <screen x="0" y="0" width="1707" height="1019" /> </state> <state width="1663" height="274" key="GridCell.Tab.0.left/0.0.1707.1019@0.0.1707.1019" timestamp="1718678758040" /> <state width="1663" height="274" key="GridCell.Tab.0.right" timestamp="1718678758041"> <screen x="0" y="0" width="1707" height="1019" /> </state> <state width="1663" height="274" key="GridCell.Tab.0.right/0.0.1707.1019@0.0.1707.1019" timestamp="1718678758041" /> <state x="334" y="84" key="SettingsEditor" timestamp="1718678034338"> <screen x="0" y="0" width="1707" height="1019" /> </state> <state x="334" y="84" key="SettingsEditor/0.0.1707.1019@0.0.1707.1019" timestamp="1718678034338" /> <state x="93" y="93" width="1521" height="833" key="com.intellij.history.integration.ui.views.DirectoryHistoryDialog" timestamp="1718531318720"> <screen x="0" y="0" width="1707" height="1019" /> </state> <state x="93" y="93" width="1521" height="833" key="com.intellij.history.integration.ui.views.DirectoryHistoryDialog/0.0.1707.1019@0.0.1707.1019" timestamp="1718531318720" /> <state x="538" y="334" key="com.intellij.ide.util.TipDialog" timestamp="1718716314753"> <screen x="0" y="0" width="1707" height="1019" /> </state> <state x="538" y="334" key="com.intellij.ide.util.TipDialog/0.0.1707.1019@0.0.1707.1019" timestamp="1718716314753" /> </component> </project>
100+评论
captcha
    相关资源
    类型标题大小时间
    ZIPwindows11编译安装pysqlcipher3152.5KB9月前
    ZIP数据可视化的可视化大屏课程设计10.08MB9月前
    ZIPwindows11编译安装pysqlcipher32.64MB9月前
    ZIP爬取豆瓣电影top250和爬取当当网数据1.95KB9月前
    ZIP迈德威视SDK同时驱动4个工业相机实时视频采集及显示11.05KB9月前
    ZIPvm的远程登录软件SecureCRTPortable和MobaXterm-Personal64.19MB9月前
    ZIPtypst Windows 安装包13.98MB9月前
    ZIP前端页面（使用html+js+css实现轮播图效果）11.38MB9月前