Dev/resnet 18 support #3
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…6199) This file was inadvertantly renamed in tensorflow#6071.
* Add flag to enable XLA in Keras models * Fix lint errors (some of them are old errors)
This import from google3.third_party doesn't work.
* Update official resnet for multi worker training with distribution strategies. * Fixes for multi worker training. * Fix call to `get_distribution_strategy`. * Undo test change. * Fix spacing. * Move cluster configuration to distribution_utils. * Move train_and_evaluate out of loop. Also, update docstrings for multi-worker flags and add use_train_and_evaluate flag. * Update distribution_strategy flag to match exported name for collective strategy.
tensorflow#6213) * Allow user to specify root_data_dir in the benchmark class constructor * Address comments
tensorflow#6246) This is needed to avoid breaking benchmark execution if PerfZero provides more Named arguments before the benchmark class constructor is updated.
* Remove isintance change for contrib strategy Replace it with class name check instead which should work regardless * Add quotes for string * fix quote type
…ed info. (tensorflow#6231) * \nRefactor deeplab to use MonitoredTrainingSession\n PiperOrigin-RevId: 234237190 * Update export_model.py * Update nas_cell.py * Update nas_network.py * Update train.py * Update deeplab_demo.ipynb * Update nas_cell.py
…esnet50KerasBenchmarkReal (tensorflow#6259)
* Fixed incorrect tensor * Replaced xrange with range for python3 compatibility
…uring his 2018 summer internship at Google. The work has been accepted to CVPR 2019. (tensorflow#6274)
* Add benchmarks for thread tuning. * Address comment/ * Add a comment.
tensorflow#6282) * s/CollectiveAllReduceStrategy/MultiWorkerMirroredStrategy * More s/contrib.distribute/distribute.experimental
* Added XLA test with a monkey-patched op to avoid OOM * Added doc strings in Keras benchmarks to avoid Lint error
* tmp commit * tmp commit * first attempt (without eval) * Bug fixes * bug fixes * training done * Loss NAN, no eval * Loss weight problem solved * resolve the NAN loss problem * Problem solved. Clean up needed * Added a todo * Remove debug prints * Extract get_optimizer to ncf_common * Move metrics computation back to neumf; use DS.scope api * Extract DS.scope code to utils * lint fixes * Move obtaining DS above producer.start to avoid race condition * move pt 1 * move pt 2 * Update the run script * Wrap keras_model related code into functions * Update the doc for softmax_logitfy and change the method name * Resolve PR comments * working version with: eager, DS, batch and no masks * Remove git conflict indicator * move reshape to neumf_model * working version, not converge * converged * fix a test * more lint fix * more lint fix * more lint fixes * more lint fix * Removed unused imports * fix test * dummy commit for kicking of checks * fix lint issue * dummy input to kick off checks * dummy input to kick off checks * add collective to dist strat * addressed review comments * add a doc string
* fix resnet breakage and add keras end-to-end tests * delint * address PR comments
* Mixed precision support * Add TODOs
* replace the usage of python's built in sort with numpy's argsort, which is faster. Also use the given axes to get the most_likely_words instead of calling enumerate and list (it's slower and more memory conssuming) * correct indentation and redaction on comment for the changes purposes according to cshallue's comment
…disable checkpointing. (tensorflow#6317) * s/CollectiveAllReduceStrategy/MultiWorkerMirroredStrategy * More s/contrib.distribute/distribute.experimental * Collective communication options in MultiWorkerMirroredStrategy. * Minor fixes * No checkpointing if multi worker. * turn off checkpointing * fix lint
…flow#6320) * Internal changes PiperOrigin-RevId: 237183552 * update readme PiperOrigin-RevId: 237184584
236813471 by lzc:
Internal change.
--
236507310 by lzc:
Fix preprocess.random_resize_method config type issue. The target height and width will be passed as "size" to tf.image.resize_images which only accepts integer.
--
236409989 by Zhichao Lu:
Config export_to_tpu from function parameter instead of HParams for TPU inference.
--
236403186 by Zhichao Lu:
Make graph file names optional arguments.
--
236237072 by Zhichao Lu:
Minor bugfix for keyword args.
--
236209602 by Zhichao Lu:
Add support for PartitionedVariable to get_variables_available_in_checkpoint.
--
235828658 by Zhichao Lu:
Automatically stop evaluation jobs when training is finished.
--
235817964 by Zhichao Lu:
Add an optional process_metrics_fn callback to eval_util, it gets called
with evaluation results once each evaluation is complete.
--
235788721 by lzc:
Fix yml file tf runtime version.
--
235262897 by Zhichao Lu:
Add keypoint support to the random_pad_image preprocessor method.
--
235257380 by Zhichao Lu:
Support InputDataFields.groundtruth_confidences in retain_groundtruth(), retain_groundtruth_with_positive_classes(), filter_groundtruth_with_crowd_boxes(), filter_groundtruth_with_nan_box_coordinates(), filter_unrecognized_classes().
--
235109188 by Zhichao Lu:
Fix bug in pad_input_data_to_static_shapes for num_additional_channels > 0; make color-specific data augmentation only touch RGB channels.
--
235045010 by Zhichao Lu:
Don't slice class_predictions_with_background when add_background_class is false.
--
235026189 by lzc:
Fix import in g3doc.
--
234863426 by Zhichao Lu:
Added fixes in exporter to allow writing a checkpoint to a specified temporary directory.
--
234671886 by lzc:
Internal Change.
--
234630803 by rathodv:
Internal Change.
--
233985896 by Zhichao Lu:
Add Neumann optimizer to object detection.
--
233560911 by Zhichao Lu:
Add NAS-FPN object detection with Resnet and Mobilenet v2.
--
233513536 by Zhichao Lu:
Export TPU compatible object detection model
--
233495772 by lzc:
Internal change.
--
233453557 by Zhichao Lu:
Create Keras-based SSD+MobilenetV1 for object detection.
--
233220074 by lzc:
Update release notes date.
--
233165761 by Zhichao Lu:
Support depth_multiplier and min_depth in _SSDResnetV1FpnFeatureExtractor.
--
233160046 by lzc:
Internal change.
--
232926599 by Zhichao Lu:
[tf.data] Switching tf.data functions to use `defun`, providing an escape hatch to continue using the legacy `Defun`.
There are subtle differences between the implementation of `defun` and `Defun` (such as resources handling or control flow) and it is possible that input pipelines that use control flow or resources in their functions might be affected by this change. To migrate majority of existing pipelines to the recommended way of creating functions in TF 2.0 world, while allowing (a small number of) existing pipelines to continue relying on the deprecated behavior, this CL provides an escape hatch.
If your input pipeline is affected by this CL, it should apply the escape hatch by replacing `foo.map(...)` with `foo.map_with_legacy_function(...)`.
--
232891621 by Zhichao Lu:
Modify faster_rcnn meta architecture to normalize raw detections.
--
232875817 by Zhichao Lu:
Make calibration a post-processing step.
Specifically:
- Move the calibration config from pipeline.proto --> post_processing.proto
- Edit post_processing_builder.py to return a calibration function. If no calibration config is provided, it None.
- Edit SSD and FasterRCNN meta architectures to optionally call the calibration function on detection scores after score conversion and before NMS.
--
232704481 by Zhichao Lu:
Edit calibration builder to build a function that will be used within a detection model's `postprocess` method, after score conversion and before non-maxima suppression.
Specific Edits:
- The returned function now accepts class_predictions_with_background as its argument instead of detection_scores and detection_classes.
- Class-specific calibration was temporarily removed, as it requires more significant refactoring. Will be added later.
--
232615379 by Zhichao Lu:
Internal change
--
232483345 by ronnyvotel:
Making the use of bfloat16 restricted to TPUs.
--
232399572 by Zhichao Lu:
Edit calibration builder and proto to support class-agnostic calibration.
Specifically:
- Edit calibration protos to include path to relevant label map if required for class-specific calibration. Previously, label maps were inferred from other parts of the pipeline proto; this allows all information required by the builder stay within the calibration proto and remove extraneous information from being passed with class-agnostic calibration.
- Add class-agnostic protos to the calibration config.
Note that the proto supports sigmoid and linear interpolation parameters, but the builder currently only supports linear interpolation.
--
231613048 by Zhichao Lu:
Add calibration builder for applying calibration transformations from output of object detection models.
Specifically:
- Add calibration proto to support sigmoid and isotonic regression (stepwise function) calibration.
- Add a builder to support calibration from isotonic regression outputs.
--
231519786 by lzc:
model_builder test refactor.
- removed proto text boilerplate in each test case and let them call a create_default_proto function instead.
- consolidated all separate ssd model creation tests into one.
- consolidated all separate faster rcnn model creation tests into one.
- used parameterized test for testing mask rcnn models and use_matmul_crop_and_resize
- added all failures test.
--
231448169 by Zhichao Lu:
Return static shape as a constant tensor.
--
231423126 by lzc:
Add a release note for OID v4 models.
--
231401941 by Zhichao Lu:
Adding correct labelmap for the models trained on Open Images V4 (*oid_v4
config suffix).
--
231320357 by Zhichao Lu:
Add scope to Nearest Neighbor Resize op so that it stays in the same name scope as the original resize ops.
--
231257699 by Zhichao Lu:
Switch to using preserve_aspect_ratio in tf.image.resize_images rather than using a custom implementation.
--
231247368 by rathodv:
Internal change.
--
231004874 by lzc:
Update documentations to use tf 1.12 for object detection API.
--
230999911 by rathodv:
Use tf.batch_gather instead of ops.batch_gather
--
230999720 by huizhongc:
Fix weight equalization test in ops_test.
--
230984728 by rathodv:
Internal update.
--
230929019 by lzc:
Add an option to replace preprocess operation with placeholder for ssd feature extractor.
--
230845266 by lzc:
Require tensorflow version 1.12 for object detection API and rename keras_applications to keras_models
--
230392064 by lzc:
Add RetinaNet 101 checkpoint trained on OID v4 to detection model zoo.
--
230014128 by derekjchow:
This file was re-located below the tensorflow/lite/g3doc/convert
--
229941449 by lzc:
Update SSD mobilenet v2 quantized model download path.
--
229843662 by lzc:
Add an option to use native resize tf op in fpn top-down feature map generation.
--
229636034 by rathodv:
Add deprecation notice to a few old parameters in train.proto
--
228959078 by derekjchow:
Remove duplicate elif case in _check_and_convert_legacy_input_config_key
--
228749719 by rathodv:
Minor refactoring to make exporter's `build_detection_graph` method public.
--
228573828 by rathodv:
Mofity model.postprocess to return raw detections and raw scores.
Modify, post-process methods in core/model.py and the meta architectures to export raw detection (without any non-max suppression) and raw multiclass score logits for those detections.
--
228420670 by Zhichao Lu:
Add shims for custom architectures for object detection models.
--
228241692 by Zhichao Lu:
Fix the comment on "losses_mask" in "Loss" class.
--
228223810 by Zhichao Lu:
Support other_heads' predictions in WeightSharedConvolutionalBoxPredictor. Also remove a few unused parameters and fix a couple of comments in convolutional_box_predictor.py.
--
228200588 by Zhichao Lu:
Add Expected Calibration Error and an evaluator that calculates the metric for object detections.
--
228167740 by lzc:
Add option to use bounded activations in FPN top-down feature map generation.
--
227767700 by rathodv:
Internal.
--
226295236 by Zhichao Lu:
Add Open Image V4 Resnet101-FPN training config to third_party
--
226254842 by Zhichao Lu:
Fix typo in documentation.
--
225833971 by Zhichao Lu:
Option to have no resizer in object detection model.
--
225824890 by lzc:
Fixes p3 compatibility for model_lib.py
--
225760897 by menglong:
normalizer should be at least 1.
--
225559842 by menglong:
Add extra logic filtering unrecognized classes.
--
225379421 by lzc:
Add faster_rcnn_inception_resnet_v2_atrous_oid_v4 config to third_party
--
225368337 by Zhichao Lu:
Add extra logic filtering unrecognized classes.
--
225341095 by Zhichao Lu:
Adding Open Images V4 models to OD API model zoo and corresponding configs to the
configs.
--
225218450 by menglong:
Add extra logic filtering unrecognized classes.
--
225057591 by Zhichao Lu:
Internal change.
--
224895417 by rathodv:
Internal change.
--
224209282 by Zhichao Lu:
Add two data augmentations to object detection: (1) Self-concat (2) Absolute pads.
--
224073762 by Zhichao Lu:
Do not create tf.constant until _generate() is actually called in the object detector.
--
PiperOrigin-RevId: 236813471
# Conflicts: # research/object_detection/core/preprocessor.py
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.